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How  good  are  global  Newton  methods.  Part  2 

A.  A.  Goldstein* 

In  the  first  part  of  this  ms.  we  made  some  observations  about  global  Newton  methods 
on  a  simple  class  of  mappings  from  a  real  separable  Hilbert  space  H  into  H.  The  map 
F  was  assumed  to  be  everywhere  differentiable  with  a  derivative  D  that  was  onto  and 
satisfied  /*||h||  <  ||Z?(x)/i)J  <  A||/i||,  for  all  h  G  H  and  some  p  >  0.  Relying  on  theorems  of 
Nemerovsky  and  Yudin(1977),  we  showed  that  no  formulation  of  a  global  Newton  method 
could  achieve  better  than  linear  convergence  at  a  certain  specified  rate  for  every  member 
of  the  class.  Assuming  that  D  was  uniformly  Lipschitz  continuous  with  constant  L  it 
was  easy  to  utilize  the  Kantorovich  inequalities  (1948).  Points  satisfying  the  Kantorovich 
inequalities  are  guaranteed  to  be  a  satisfactory  initial  point  for  Newton’s  method.  By 
satisfactory,  we  mean  that  the  sequence  converges  to  a  root  at  a  quadratic  rate,  as  will 
be  seen  below.  Following  a  similar  terminology  of  Smale(1986),  such  points  will  be  called 
approximate  roots. 

We  used  the  Kantorovich  inequalities  to  formulate  a  coarse  version  of  Smale’s  global 
Newton  method  to  obtain  the  complexity  of  the  algorithm  in  this  setting.  The  Kan¬ 
torovich  condition  is  :  if  xo  satisfies  ||P-1(xo)||  ||Z7_1(xo)ir'(xo)||T  =  flrjL  <  .5 

then  Xo  is  an  approximate  root.  Here  L  is  the  Lipschitz  constant  for  D  on  the  ball 
B  =  {x  G  H  :  ||x  —  x0||  <  2|jD_1(xo)Ir(xo)||}.  We  found  that  starting  at  x0  we  could 
achieve  a  point  satisfying  the  Kantorovich  inequalities  in  less  than: 

11.46  [||F(xo)j|T//i2  ]  In  (1.443  In  8Q)  steps 

where:  L  is  the  global  Lipschitz  constant,  and  Q  =  X/p  the  condition  number.  It  is 
noteworthy  that  this  algorithm  is  insensitive  to  the  condition  number.  When  the  word 
‘steps’  appears  in  this  paper,  as  above,  we  mean  the  preceding  formula  to  be  rounded  up 
to  the  nearest  integer. 

Some  numerical  experiments  however  were  disappointing.  The  poor  performance  stemmed 
from  our  reliance  on  the  Kantorovich  inequality.  This  inequality  is  overconservative  when 

*  supported  by  grant  NPS  LMC-M4E1 


the  dimension  of  H  exceeds  1.  In  a  test  example  even  though  we  estimated  L  along  only 
one  ray  (in  the  direction  of  the  Newton  step)  and  thus  determined  a  L  that  was  a  lower 
bound,  we  found  approximate  roots  where  the  Kantorovich  constant  /3  rj  L  was  several 
thousand  instead  of  <  1/2.  (See  definition  1.5  below).  For  this  reason  we  undertook  to 
revise  the  Kantorovich  inequalities,  hoping  to  obtain  better  sufficient  conditions.  We  shall 
do  this  by  avoiding  the  Schwarz  inequality  at  a  key  spot.  In  general  we  were  guided  by 
Kantorovich’s  original  proof.  A  parameter  K  replaces  L  on  the  ball  B.  Estimates  are  given 
for  the  decrease  in  the  norm  of  the  vector  valued  function.  This  leads  to  the  definition  of  a 
an  e  approximate  root.  We  believe  this  concept  will  be  useful  in  the  further  development  of 
global  Newton  algorithms.  The  estimates  we  give  for  the  convergence  rates  can  probably 
improved  by  a  one  dimensioned  analysis,  as  was  done  by  Gragg  and  Tapia(1974)  for  the 
Kantorovich  Theorem.. 

One  consequence  of  the  revised  proof  is  that  the  derivative  operator  need  not  be  continuous, 
although  Lipschitz  continuity  is  convenient  in  a  neighborhood  of  each  root.  As  an  example 
we  consider  the  problem  of  solving  linear  inequalities.  (Phase  1  linear  programming)  By 
the  use  of  Lagrange  multipliers  the  method  presented  here  can  be  extended  to  linear  pro¬ 
gramming  and  other  types  of  programs.  We  shall  however  only  consider  linear  inequalities 
in  this  ms.  The  idea  of  using  Newton’s  method  for  linear  programming  may  be  found  in 
Smale(1986).  Our  technique  will  be  to  use  a  penalty  function  approach.  In  this  setting 
we  have  a  twice  differential  convex  function  to  minimize,  with  jump  discontinuities  in  the 
second  derivative.  For  the  code  we  refurbished  an  old  global  Newton  method  of  our  own. 
This  was  easy  because  it  was  already  up  and  running.  We  tried  the  method  on  an  example 
due  to  C.  Blair(in  Kortanek  and  Shi  1987)  that  is  a  version  of  the  famous  Klee-Minty 
example.  This  problem  was  suggested  to  us  by  Ken  Kortanek,  and  we  are  thankful  for  his 
kind  help.  While  Ken  was  visiting,  he  ran  his  scaling  (modified  Karmarker)  algorithm  on 
my  computer  for  a  benchmark  in  the  10  variable  case.  The  robust  ‘Superlindo’  by  Linus 
Schrage  was  also  used  as  a  benchmark  for  these  problems.  For  8,  10,  and  12  variables 
Superlindo  took  35,  311,  and  2236  iterations  respectively.  Our  algorithm  hardly  changed 
in  the  number  of  steps  versus  dimension.  Ken  Kortanek  remarked  he  noticed  the  same 
phenomena  with  their  algorithm.  In  the  appendix  appears  a  list  of  15  consecutive  runs 
for  the  case  n=12  with  the  components  of  the  initial  point  being  fed  by  a  random  number 
generator  with  values  between  -1000  and  1000.  The  number  of  steps  until  termination  ran 
between  6  Newton  steps  plus  2  gradient  steps,  and  12  Newton  steps  plus  3  gradient  steps. 
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The  average  was  8  Newton  steps  and  19/15  gradient  steps.  Full  double  precision  accuracy 
was  achieved.  The  Kortanek-Shi  algorithm  in  the  10  variable  case  was  almost  as  feist  as 
ours  for  this  case,  but  it  achieved  only  3  significant  figure  accuracy. 

These  spectacular  results  were  unexpected.  Unlike  the  Smale  global  Newton  method, 
which  we  as  yet  have  not  implemented,  the  method  we  used  is  sensitive  to  the  condition 
number  of  the  system.  See  3.0  below. 

There  remains  to  test  the  algorithm  on  a  general  mix  of  problems  to  see  if  it  is  worth 
adding  to  the  armamentarium  of  linear  programming.  Thus  the  question  of  whether  we 
have  a  viable  method  is  not  settled  at  this  time. 
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In  what  follows,  the  Kantorovich  inequality  will  be  sharpened.  Let  f  be  Frechet  differen¬ 
tiable  mapping  between  real  Banach  spaces  E  and  F.  Let  f'(x)  denote  the  derivative  at  x 
and  f'-i(x)  its  inverse.  The  Kantorovich  inequality  states  that  if  xo  is  given  such  that  f  is 
Lipschitz  continuous  with  constant  K  on  the  ball  {x  G  E  :  ||x  — xo||  <  2  ||/li(£o)/(zo)||  = 
2  rjo},  if  ||/la(x0)||  =  Po  and  if  tjoPoK  <  1/2,  then  xo  is  an  approximate  root.  This 
means  that  the  sequence  generated  by  Newton’s  method  will  converge  quadratically  to  a 
root  at  least  as  fast  as  the  rate  estimated  by  the  theorem  below. 


THEOREM  1.0  Let  f  be  a  map  between  real  Banach  spaces  E  and  F.  Assume 
f  is  Frechet  differentiable  on  an  open  subset  E'  of  E.  Let  xo  G  E'  be  given  such  that 
(/'(x0))_1  =  /l,(xo)  exists.  Set 

no  =  ll/!i(zo)/(*o)!l 


5  =  {x  G  E  :  ||x  —  xo ||  <  1.68  rj0  }.  Assume  that  S  C  E' 

Set 


0o  =  ||/li (*o)||  ,  and  let 

5' =  {x6  5:11/1, (x)||  <2.3A>}- 


Finally  set: 


H 


sup 


ll/-i(*)(/'(*)  -  /'(fflll 


il/-i(*)li  n/r,(*)/(x)ii 


:  x  G  S'  ,  ^  =  x  +  t/l,(x)/(x)  and  t  e  (0, 1)  >  . 


If  t]0/30K  =  h0  <  1/3,  then  x0  is  an  approximate  root. 


PROOF  By  hypothesis  x,  is  well  defined.  Let  j?j(xo,x,)  =  Hi  =  /li(x0)/'(xi )  = 
I  —  /l,(xo)(/'(xo)  —  f'(xi)).  Hi  maps  E  into  itself.  Our  hypotheses  imply  that 
\\fLi(xo)(f'{xo)  —  /'(x,))||  <  h0  <  1/3,  whence  Hi  has  an  inverse.  We  have  the  estimate 
||(#i)-1||  =  (1  -  h0)~l  <  3/2.  Also  \\Hi\\  <  4/3.  Observe  that  f'{x0)Hi  =  /'(x,)  and 
(Hi)'1  f'_i(x0)  —  f'-i(xi)-  Thus  f'-i(xi)  exists  and  X2  is  well  defined. 


Let  fa  =  ||/l,(xi)||  and  rji  =  ||x,  -  x2||.  Thus  px  =  ||/l,(a:i)||  <  1-5  ||/lx(jro )(|- 
Let  Fi  be  defined  by  the  formula  Fi(x)  =  x  -  f'-i(xo)f(x).  Since  F,(x0)  =  xi  and 
Fi(xi)  =  x,  -  /l,(x0)/(x,), 

f'-i(x0)f(xi)  =  F,(x0)  -  Fi(xi). 
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By  the  generalized  mean  value  theorem  of  Graves(1927), 

||*U*i)  ~  *i(*o)||  <  sup{  ||^(f)||  •'  t  £  (0,1)  and  £  =  ix0  +  (1  -  t)x i  }||an  -  x0||. 

But  ||F'(0||  =  11/  -  /!»(* o)/#(OII  =  ll/li(*o)(/'(*o)  -  /'(0)ll  <  Kn oPo.  Thus: 

\\f-l(xl)f(xl)\\  =  ho  »?0, 

m  =  ll/Li(*i)/(*i)H  -ll^r1/li(*o)/(xi)||<  Mo(i-M_1 

and 

hi  =  fam K  <  (1  -  h0)~2hl  <  9^/4  <  1/4 

At  this  juncture  our  estimate  will  differ  from  that  of  Kantorovich  by  a  factor  of  1/2  that 
will  appear  in  the  recursion  for  hn.  Kantorovich  gains  a  factor  of  1/2  because  of  the 
Lipschitz  condition  (or  2nd  differentiability  condition)  on  H.  Clearly  xy  and  x 2  belong  to 
S,  and  also  to  S'.  Now  define  in  turn  H2,  02 ,  Vii  ^2 ,  and  h2,  mutatis  mutandis,  to  obtain 
0 2,  rj 2,  and  h2  in  terms  of  0i,  f)  1,  and  hi. 

For  k=l,2,3,...,n,  assume  that  PkVkK  <  1/3  and  x*  €  S'.  Assume  moreover  that  the 
recursion  formulae: 


0n  ~  0n  —  l(l  — 1 )  1  Vn  =  hn_i»Jn_i(l  “  hn-l )  1  ~  ^«-l)  1 


hold  for  k=l,2,3,...,n.  Since  these  recursion  formulae  hold  also  for  k  =  n-f  1,  we  have  the 
following  sequence  for  {h*} 

1111  1 
3’  4’  64’  3968  ’  "  '  ’  -  l)2 


Since: 


0n+ 1  <  00 


( 


1 _ 1 

(1  —  ho)  (1  —  hj) 


1 

(1  -hH) 


) 


*?n+l  Sl  T]o 


ho  hi  h2 
—  ho  1  —  hi  1  —  h2 


hn  \ 

1  -hn) 


and 


||/'(x„+1)||  <  ||/'(xo)||  (1  +  ho)  (1  +  hi)  ,  (1  +  hn) 
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We  get  from  above  the  formulae: 


Pn+l 


4  •  9  •  64  •  3969  •  1575024 


8  •  63  •  3968  •  1575023- 


124-  -1  \ 

- ^  J  <  2.3  fo,  for  n  =  1,2,3,... 


„  <„  (i  I  I  J_  J_  \ 

7n+!  -  7o  3  g  63  3967  , (1  _  J 

11/  Ml  <  11/  (^o)ll  ^  3~'  4  :~9~ ~64  ~ 3969 , •  {hn)~l  ) 

||/'(*n+i!|  <  1.9||/'(io)||  for  n  =  1,2,3 . 


To  complete  the  induction  we  show  that  xh+i  €  S' .  The  triangle  inequality  gives: 

||xn+l  ~  X0 1|  <  »7o  +  T]i  +, Tjn 

s’,»(1  +  \  +  5  +  5  +  3 m+ . n  T~hl)  -  1'681„  f°rn  =  1'2.3... 

Thus  xn  6  5.  Since  /?n+i  <  2.3/?o  by  the  above  inequality,  the  induction  is  completed. 
Similarly  we  have: 


ll^n+p+l  ~  Zn||  <  7n  +  Vn+l  +  J?„+p  <  1.68r/n. 


Since  {rjn}  converges  to  0,  the  sequence  {xn}  is  Cauchy  with  limit,  say  x*.  Since  f(xn)  = 
/'(*«)( Xn+1  -  *n),  {/K)}  converges  to  0,  and  /(x*)  =  0. 


2n 

We  now  estimate  the  rate  of  convergence.  We  have,  at  worst,  that  hn  <  £(!M  < 

2  ** 

|(|)  .  The  recursion  formula  for  r?„  implies  that 

*ln  <  hn-ihn-2---hoT]o(l  -  hn- i)~1(l  -  hn_2)_1...(l  -  ho)-1- 

Also,„<(|)"(fft„)!""(|/1,)J"-J...(f/i0)%.  Sinccn=i2n“*  =  2“  -  1, 

rjo  9  4 

Since  ||/(x„)||  =  ||/'(*n)||  Vm  while  |j/'(x„)||  <  1.9  ||/'(x0)||,  we  have  the  estimates 


(  T\  <  IQ 

IlfMII  -  m 


and  {II)  <  1.68  —. 

Ifi  -  Z0||  7o 
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REMARK  1.1  Assume  the  hypotheses  of  the  theorem  with  suitable  changes  in  S  and  S'. 
Take  ho  <  1/2.  Then  Xo  is  an  approximate  root. 

REMARK  1.2  The  theorem  does  not  require  the  continuity  of  /'.  Let  f(x)  =  4x,  if 
oo  <  x  <  1  and  f(x)  =  6x  -2,  if  x  >  1.  Then  every  point  is  an  approximate  root  for 
f.  For  example  let  xo  =  100.  Then  ho  =  1/3,  xi  =  1/3,  hi  =  0,  and  X2  =  0. 

REMARK  1.3  Let  S,  S'  and  K  be  defined  as  above.  Assume  that  f  is  Lipschitz  continuous 
with  constant  L  on  S.  Let  /i*  =  suP{||/-i(xfc)(/'(xo)  ~  /'(Oil  ■  x  e  S'  and  (  =  xk  + 
*/-i(x*)/(x*)>*  €  (0, 1)}-  Assume  the  Kantorovich  inequality  holds.  Then  hk  <  flkVkL  < 
1/3  .  Whence  hk/fikVk  =  K  <  L  .  We  have  replaced  L  by  K.  Another  hypothesis  to  ensure 
the  boundedness  of  K  (which  we’ve  assumed  outright)  is  to  require  that  /'  be  bounded  on 
S'  and,  for  any  root  x*  of  f  there  is  a  neighborhood  N(x*)  e  such  that  /'  is  Lipschitz 
continuous  on  N(x*)flS'. 

REMARK  1.4  The  Kantorovich  type  theorems  are  important  for  the  insight  they  furnish, 
but  in  general  are  not  helpful  in  concrete  instances.  For  example,  the  above  theorem  and 
the  original  Kantorovich  theorem  are  dependent  upon  the  knowledge  of  the  constant  K  or 
L,  but  the  determination  of  upper  bounds  for  these  quantities  is  not  trivial.  Moreover  the 
conditions  given  by  these  inequalities  is  sufficient  but  not  in  general  necessary  for  a  point 
to  be  an  approximate  root.  Thus  the  determination  of  approximate  roots  is  usually  not 
practical  with  these  theorems.  Using  the  rough  estimates  furnished  by  local  application  of 
the  modified  Kantorovich  inequality  we  propose  proceeding  by  trial. 

DEFINITION  1.5  Given  e  >  0,  let  n  be  the  smallest  integer  such  that 


A  point  xo  is  an  e-approximate  root  for  the  mapping  f  if  the  Newton  sequence  {x,} 
starting  at  xo  is  well  defined  for  i=l,2,...,  n,  and 

ll/(xn)|| 

!l/(xo)ll 

For  example  if  e  =  10-18  then  n  =  7.  This  test  follows  from  the  estimates  I  and  II  of  the 
above  theorem. 


LEMMA  2.0  Let  A  be  a  positive  definite  matrix.  Let  fj.  be  its  least  eigenvalue  and  A  its 
greatest.  Let  Q  =  A//i.  Then: 

[Ax,z]  ^2  Q 
l|Ar||  ||x||  -  Qi  (Q  +  iy 

The  bound  is  the  best  possible. 

PROOF.  Assume  A  has  been  diagonalized,  and  let 

[Ax,x\/n  =  x\  +  c2X2+,...,c„x£. 

We  seek  to  minimize  f(x)  —  (z^  +  c2x2+,  ...,c4x*)/(x\  +  <3^x\  =,  subject  to 

||z||  =  1.  The  reason  for  restricting  to  polynomials  of  degree  4  in  xf  will  become  apparent 
in  what  follows. 

Set  x\  ~  1  —  x\  —  x\  —  I4.  Using  this  equation  to  eliminate  ij  we  get: 

...  _  1  +  (c,  -  l)ll  +  (c,  -  1  )*%  +  (c<  -  l)xj 

(1  +  (c^  -  1)^  +  (c5  -  1)!?  +  (ci  -  l)xl)i 

Let  P  denote  the  numerator  of  the  above  fraction  and  Qs  the  denominator.  Let  x  = 
{xl,  x\ ,  x\)  and 

A  =  (c2  -  1,  c3  -  1,  c4  -  1) 

and 

B  =  (cl-  1,  c\  -  1 ,  cj-  1) 

The  components  of  the  equation  V/(x)  =  0  may  be  written  as  : 

z2(c2  -  1)[2B  -  (c2  +  1)A,  z]  =  x2(cc  l)(c2  1)  (a) 

*3(03  -  1)[2£  -  (c3  +  1)A,  zj  =  z3(c3  l)(c3  1)  ( b ) 

z4(c4  —  1)[2B  —  (c4  +  1)A,  z]  =  z4(c4  -  l)2  (c) 

If  we  assume  distinct  eigenvalues  and  that  x2,  x3  and  z4  arc  non-zero  we  may  cancel 
appropriately  and  obtain  from  (a),  (b),  and  (c),  a  system  of  3  linear  equations  of  rank  2. 
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since  the  rows  of  the  system  are  linear  combinations  of  A  and  B .  Thus  one  unknown  say  x2 
or  X3  (but  not  x4  )  may  be  set  to  0.  Similarly  if  we  had  n  variables  only  one  variable  among 
x2  and  x„_l  would  be  non-zero.  If  we  set  X2  =  0,  then  the  following  system  obtains: 

(cl  -  l)r!  -t-  (c4  -  l)(c4  -  c3)x'£  =  c3  -  1 

(4  ~  1)*1  +  (c\  -  \)x\  =  c4  -  1 

One  finds  that 

2  _  _ (c3  ~  i)(c4  ~  C3 ) _  „ 

4  -(c3  -  l)(c3  +  l)(c4  -  l)(c4  -  c3 ) 

Since  x\  is  negative,  it  is  inadmissible.  Thus  x\  must  also  vanish.  Suppose  now  that  x3  = 
0  but  X2  ^  0.  We  again  get  x\  <  0.  Thus  for  these  cases  we  must  set  x2  and  x3  to  0. 

If  c2  >  1  and  c4  >  c2  then  the  rank  of  {A,B}  =  2  This  case  is  treated  just  as  the  case 
above  of  distinct  roots.  If  all  the  eigenvalues  are  equal,  the  ratio  in  the  statement  of  the 
lemma  is  1,  verifying  the  claim  for  that  case.  For  all  other  cases  the  rank  of  {A,  B}  =  1, 
and  we  may  set  x2  and  x3  to  0. 


There  remains  to  carry  out  the  minimization.  The  equation 


(cl  —  ljx^  =  c4  —  1  implies 


and 

2-2- 

f{x)  = 

0J 


1 

O  +  i 


Algorithm  3.0 

Let  f  be  a  twice  differentiable  function  defined  on  real  euclidean  space  En.  Assume  that 
f  is  convex  and  that  it  has  bounded  level  sets.  Given  an  arbitrary  point  xo  let  S  denote 
the  level  set  {x  €  Rn  '■  /(r)  <  /(xo)}.  Assume  that  the  hessian  of  f  at  x,  which  we  call 
H(x),  has  an  inverse  at  xo,  denoted  by  H~]  (x0).  At  the  kth  step  of  the  algorithm  assume 
that  H~1(xk )  exists.  Let 

-a  =  f(x)-f(x-tH-\x)Vf(x)) 

9K  '7)  y[H-'(x)Vf(x),Vf(x)) 
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Choose  S  e  (0,1/2]  and  choose  7*  >  0  so  that  6  <  g(xk,yk)  <  1  —  6,  taking  7*  =  1, 

if  possible.  Set  x*+i  =  xk  -  7*  V/(ifc).  Let  S'  =  {xk  e  S  :  k  =  1,2,3, . }. 

Assume  that  the  spectrum  of  H(x)  is  bounded  above  on  S'  by  A Q,  and  below  by  A.  Let 

h  =  supjllff-^iX^x)  -  H(0)\\  :xeS’  and  t  =  x  +  tH~\x)V /(x),  t  €  [0,1]}. 


(a)  Assume  that  K  = 

3up{  ||lff-»(i)|M|J-»(*)V/(i)||  :xeS>  andZ  =  x  +  tH~1(x)Vf(x),  t  e  [0,1]} 

Let  N  be  the  least  integer  exceeding: 

f(x0)-minf  _  62  A3 

A  A  (1  +  2hQ1/2)K2Q1/2 

Then  an  approximate  root  of  V  f(x)  will  be  achieved  in  at  most  N  steps. 


<  00. 


(b)  Let 


62(  1  -  6)2  A3 
(1  +  2/iQi  AT2Qf 


.  Let  M  be  the  least  integer  exceeding: 


f(x 0)  -  minf 
min{A,  Ai } 

.  Then  in  at  most  M  steps  an  approximate  root  will  be  achieved,  and  all  subseqent  steps 
will  be  Newton  steps. 


PROOF  (a)  Assume  in  what  follows  that  x  €  S.  The  change  in  f  do  to  the  step 
7s(x)  =  7 H~l(x)  V  f(x)  may  be  estimated  by  Taylor’s  formula  as: 


(*)  =  /(*)  -  f(x  -7s(x))  =  7 


7  [s(x),(H(Q-H(x))s(x)} 
2  [V/(x),s(x)] 


[V/(x),s(.r)] 


or 


(**)  =  7?(*.7)[V/(x),s(x)] 


Here  ^  lies  between  x  and  x  -  7  .s(x).  By  the  above  formula  we  see  that  the  right  hand 
limit  of  g(x,  7)  at  7  =  0  is  1.  Since  S  is  bounded,  for  some  7,  <7(2,7)  =  0.  This  shows  that 
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7  may  be  chosen  as  claimed.  We  see  also  that  {/(a:*)}  is  a  decreasing  sequence  so  that 
Xk  €  S  for  k=l,2,3, . 


We  aim  now  to  find  a  lower  bound  for  A(x).  In  the  equation  (*)  above,  the  third  term  in 
the  large  brackets  is 

-  i  iiy/wi  -  h«)ii  iKx)n 

-  2  [V/(z),/f->(*)V/(*)l 

Using  lemma  2.0  we  get  the  inequalities 


If  {||  V/(xt)||}  does  not  converge  to  0,  an  infinite  subsequence  of  it  is  bounded  away  fr  m 
0.  Since  [V/(x),  s(x)]  >  ||V/(x)|j2/^A,  and  7kff(xk,7k)  is  also  bounded  away  from  fl 
f(xk)  tends  to  — oo.  This  contradiction  establishes  that  the  sequence  { V/(x* )}  converge^ 
to  0.  Moreover  every  cluster  point  of  the  set  S'  minimizes  f,  and  {/(xjt)}  converges  to 
min  f. 


If  x  does  not  satisfy  our  condition  for  an  approximate  root  then  \\H  1  (x)||  ||s(x)||J\  > 
1/2.  By  the  lemma  [V/(x),  s(x)]  >  (Q1/2 or)-1  ||s(x)||  ||V/(x)j|.  Consequently,  |js(x)||  > 
1/2 K  ||/f~1(x)||,  and  ||V/(x)||  ||s(x)||  >  l/4K2A.3.  Thus  a  lower  estimate  of  (**)  is 

A(x)  >  - ^ - r  =  A 

(1  +  2/iQWa3  K2Q± 


We  may  similarly  find  a  number  of  steps  that  will  guarantee  that  an  approximate  root  has 
been  reached  and  that  the  above  algorithm  will  always  produce  subsequent  Newton  steps. 
We  do  this  by  observing  that  ,5.K’|)s(x)||AaQ1/2  <  .5  —  6  implies  that  .5 Kh(x)aQ1^2  < 
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.5  —  6.  And  this  implies  that  6  <  g(x,  1)  <  1—6.  Thus  we  shall  count  the  steps  for 
which  ||s(x*)j|  exceeds  (1  —  26)/aKA.Q1^i .  As  above  we  find  that 


a  /  \  w  62(.5  -  6)2A3 

A(x)  >  - - - -r1 - j 

~  (l  +  2/iQitf2Qf 


=  A, 


We  now  ’’count”  the  steps.  Since  A(x*)  is  bounded  away  from  zero,  say  by  A,  we  have 

/(xo) -/(**)>  E*=0A(xO)  >  kA.  Set 


Set 


If  it 


_  /(x q)  -  minf 

A 


,,  /(x0)  —  minf 

M  =  : — — — -  . 

mm{A,  Ai} 

N,  and  xjt  is  not  an  approximate  root,  we  have  a  contradiction. 


REMARK  3.1  The  results  above  are  disappointing  in  that  the  cost  of  the  algorithm  is 
sensitive  to  the  condition  number  Q,  in  spite  of  the  fact  that  Newton  directions  are  taken. 
(Recall  that  Smale’s  global  Newton  method  was  not  sensitive  to  the  condition  number). 
Indeed  the  gradient  method  is  less  sensitive  to  Q  than  this  method.  We  may  classify  this 
algorithm  as  ’’greedy”  because  it  is  trying  to  decrease  f  at  each  iteration.  On  the  plus  side, 
the  algorithm  is  easily  implemented. 


The  most  robust  result  over  the  class  of  strongly  convex  functions  is  due  to  Nesterov.  A 
simple,  easily  coded  algorithm  using  combinations  of  gradient  steps  will  drive  f(xn)/f(x o ) 
to  less  than  e  in  less  than 

i§!n(:) stepa 

.  By  the  theory  of  Nemerovsky  and  Yuden,  for  some  positive  number  c  no  algorithm 
can  do  better  than  the  following  number  of  steps  for  every  strongly  convex  function  of 
condition  number  Q: 

min(n,  VQ)  in  i 
lnmin(n,y/Q )  e 

For  the  case  when  n  >  \fQ  we  can  assert  that  Nesterov’s  method  is  to  within  a  slowly 
changing  multiplicative  factor  essentially  optimal  over  the  class  of  strongly  convex  func¬ 
tions.  This  method  and  its  generalizations  are  being  studied  by  Osman  Guler  at  U.  of 
Chicago,  School  of  Business. 


12 


Consider  the  Smale  global  Newton  method  applied  to  minimizing  strongly  convex  functions 
of  condition  number  Q.  This  method  which  is  sensitive  to  a  Lipschitz  constant  for  the 
Hessian  would  not  be  a  candidate  for  optimality  on  the  set  of  strongly  convex  functions. 
The  reason  is  that  there  exist  strongly  convex  functions  with  condition  number  Q  that  have 
Hessians  with  arbitrarily  large  Lipschitz  constants.  However  for  the  multitude  of  natural 
problems  with  bounded  Lipschitz  2nd  derivatives,  or  bounded  values  of  the  constant  K, 
we  should  expect  better  results  for  large  condition  numbers  from  the  Smale  global  Newton 
method,  than  with  an  algorithm  of  the  Nesterov  type. 
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We  now  digress  to  the  problem  of  linear  inequalities.  Let  A  be  an  m  by  n  matrix  of  rank 
n,  and  b  an  m  by  1  matrix.  Denote  the  ith  row  of  A  by  A*.  Set 

R(x)  =  Ax  —  b. 

We  seek  a  solution  of  the  system  of  inequalities  : 

Ri(x)  <  0  1  =  1,2, 

Or,  if  this  system  has  no  solution,  to  establish  its  inconsistency.  Let  G(x)  =  max{Rt(x)  : 
1  <  i  <  m}.  We  assume  that  G  is  bounded  below,  and  consequently,  that  G  has  bounded 
level  sets.  To  ensure  that  this  is  the  case,  a  phony  half-space  may  be  added  to  our  system  of 
inequalities.  Let  A0  =  —  Let  Rq(x)  =  [A0,x]  —b.  Let  G*(x)  =  max{ii,(x)  :  0  < 

i  <  m}].  Let  z(b)  =  argmin  G*.  If  the  original  system  is  consistent  then  for  b  sufficiently 
large  G(z(b))<  0. 

We  shall  employ  the  penalty  function: 

m 

y^[mar(0,  R^x))]**  with  p  >  2 
i=l 

We  note  that  for  p  >  2  ,  F  is  convex.  If  p=2,  F'  is  continuous,  and  F"  has  jump 
discontinuities.  If  p  >  3  then  F'"  is  continuous.  Our  numerical  experiments  using  F  to 
solve  inequalities  gave  most  satisfactory  results  with  p=2,  even  though  more  smoothness 
is  obtained  with  larger  values  of  p.  Thus  in  what  follows  we  shall  take  p=2.  We  assume 
that  F  has  bounded  level  sets. 

Let  I+(x)  denote  the  set  of  all  indices  from  {1, 2, 3, ...,  m}  for  which  Ri(x)  >  0  when 
i  €  j f+(x).  If  dim{Ai  :  i  €  J+(x)}  <  n,  then  F"( x)  does  not  have  an  inverse.  We  seek  the 
following  construction. 

CONSTRUCTION  B  4.0 

Assume  that  at  Xk  the  dimension  of  the  set  of  gradients  of  the  actice  residuals  is  less  than 
n.  That  is,  dim  {A*  :  1  <  i  <  q}  <  n  Take  h  ^  0  such  that  [ Ax,h )  =  0,  1  <  i  <  q. 
Let  e/b  =  .5(F(x*-i  —  F(xjt).  Find  the  smallest  t  such  that  52{R?(x  -I-  th )  :  q  +  1  <  i  < 
m  and  Ri  >  0}  =  t\/2 (m  —  q)  Set  x/tj  =  Xk  +  th.  Repeat  this  process  if  necessary.  After 
at  most  m-q  steps  we  obtain  x*+j . 


ALGORITHM  5.0  Take  xo  arbitrarily  in  E„.  If  dim{Ai  '■  i  £  /+(xo)}  <  n  use  (4.0) 
to  find  Xj  with  dim{Ai  6  J+(xi)}  =  n ■  At  the  kth  iteration  we  are  given  x*  and  a 
non-singular  H(xk).  Choose  7*  such  that  .75  >  g(xk,  7k)  >  -25,  taking  7*  =  1,  if  possible. 
Set  x*+i  =  Xfc  —  7*.ff-1(xfc)V/(x).  If  H  has  an  inverse  at  xk+i  then  set  x*+i  =  x*+1 
Otherwise  update  x*=i  with  the  construction  (4.0)  or  (4.1)  to  obtain  x*+i. 

CLAIM  5.1  Assume  the  hypotheses  of  (4.0).  The  algorithm  is  well  defined  and  will 
terminate  in  a  finite  number  of  steps,  with  a  positive  value  of  F  if  the  system  is  inconsistent 
and  with  F  =  0  if  the  system  is  consistent.  For  the  latter  case  the  argument  of  F  is  a 
solution  of  the  inequalities. 

PROOF  Let  X=  {1  £  En  :  [A',x]  <  6t,  1  <  i  <  m}.  Assume  that  X  is  not  empty. 
Let  w  denote  the  number  of  vertices  of  the  solution  set  X,  and  let  v3  ,  s=l,2,...,w  denote 
the  vertices.  Each  v3  lies  in  the  intersection  of  at  least  n  hyperplanes  supporting  X. 
Any  point  in  X  is  on  the  right  side  (R«(x)  <  0)  of  these  hyperplanes.  Stated  otherwise: 
[A‘,w,]  =  bi,  i  £  card  I,  >  n.  Let  C(vs )  =  {x  £  En  :  [A‘,x]  >  6j,i  £  Is}  =  {x  £  En  : 
[A‘,x  —  v3\  >  0,i  £  I,}, and  let  C(v3)  denote  its  closure.  Let  Bs  be  a  ball  of  radius  rs 
centered  at  vt.  If  some  hyperplane  [A',x]  —  6,  such  that  i  £  I  ~  I3  meets  C(v3)  then  there 
exists  a  minimal  value  of  r„  such  that  B3  D  C{v3)  meets  the  closest  hyperplane  [A',x]  -  b, 
such  that  i  £  I  ~  I3.  Points  in  Bt  D  C(s)  ~  {u*}  are  on  the  wrong  side  of  the  same 
hyperplanes,  n  or  more  in  number.  In  all  the  above  sets  s  is  understood  to  range  over 
l,2,...,w. 

It  follows  from  the  proof  of  (3.0)  that  the  above  algorithm  generates  a  sequence  {x*}  £  5 
(the  level  set  of  F  at  x0  )  such  that  F(x/t)  converges  downward  to  min  F.  We  claim 
that  the  only  cluster  points  of  {x*}  are  the  vertices  v3,  s  =  1,2, The  sets  /+(xjt) 
are  collections  of  n  or  more  out  of  m  indices  that  are  repeated  infinitely  often.  Thus  at 
least  one  of  the  collections  must  be  frequently  repeated.  Let  {x*,. }  denote  a  subsequence 
converging  to  a  limit  v.  Take  a  thinner  subsequence  if  necessary  such  that  only  one  index 
set  is  represented.  Since  F(v)  =  0,  it  folows  that  v  £  X.  Since  {x*,. }  is  on  the  wrong  side 
of  at  least  n  hyperplanes  at  points  arbitrarily  close  to  X,  the  index  set  I  must  be  one  of  the 
sets  s=l,2,...,w.  Let  k  denote  the  least  value  of  k  such  that  X*  £  B,  fl  C(s)  for  some 
s  =l,2,...,w.  At  most  one  more  step  at  x-k  terminates  the  process,  because  a  Newton  step 
minimizes  the  restriction  of  F  to  B3  fl  C(v3)  -a  quadratic  function,-  in  one  step. 
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Assume  now  that  X  is  empty.  A  necessary  condition  that  a  system  of  inequalities  be 
inconsistent  is  that  0  belongs  to  the  convex  hull  of  the  rows  of  the  matrix  A.  Let  x* 
minimize  F.  We  claim  that  x*  is  unique,  card,  I+(x*)  >  n  + 1,  and  0  belongs  to  the  convex 
hull  of  the  rows  of  A.  If  card  I+(x*)  <  n  choose  h  so  that  [A*,  h]  =  — 1,  t  €  /+(x*).  Then 
for  some  h  sufficiently  small  F(x*)  can  be  decreased.  Since  x*  is  a  strict  local  minimum 
it  is  unique  because  of  the  convexity  of  F. 

Let  B  be  a  ball  centered  at  x*  with  the  property  that  I+(x)  =  I+(x*)  for  all  x  €  B.  This 
existence  of  such  a  ball  follows  from  the  continuity  of  R,(x)  for  each  i,  1  <  i  <  m,  and 
because  Ri(x*)  ^  0  for  all  i  6  I+(x*).  Because  x*  is  unique  the  sequence  fx*}  converges 
to  it.  Thus  for  some  least  k  =  k  xj  £  B.  Thus  the  solution  occurs  here  or  at  the  next 
step. 

Notice  that  the  parameter  K  of  (3.0)  is  actually  finite.  Consider  the  denominator  of  K 
for  k=0,l,2,...,fc.  Since  ||s(x)||  >  ||V/(x)||/Q£  the  denominator  is  always  positive.  (If 
V /(x)  =  0  we  have  a  solution)  One  more  step  at  x*  terminates  the  process.  The  Newton 
step  minimizes  the  quadratic  function  (restriction  of  F  to  fl,  D  C(v„)  in  one  step.  Note 
that  the  numerator  of  K  for  this  last  step  is  0,  while  the  denominator  is  positive. 

NUMERICAL  COMPUTATIONS  6.0 

The  Blair  example  may  be  found  in  Kortanek  and  Shi.  The  coefficients  for  the  case  n=8 
are  written  out  (Example  2a,  p55)  and  a  program  is  given  to  generate  the  coefficients  for 
any  n.  For  n  =  12,  the  case  for  which  we  offer  extensive  calculations,  the  Blair  problem  is 
a  linear  programming  problem  (LP)  of  the  form:  minimize  L(x)  subject  to 

Ri(x)  <0  1  <  *  <  24 

of  which  12  inequalities  constrain  x  to  lie  in  the  first  orthant.  The  coefficients  of  the 
system  are  integers  between  1  and  305,175,780.  Thus  the  system  is  very  poorly  conditioned. 
The  problem  has  a  unique  solution  Xi  =  0,  i=l,2,...,ll,  x12  =  1,  with  L{x)  =  305175780. 
The  system  we  solve  contains  following  inequalities  : 

rj(x)  <  0,  i  =  l,2, ..., 25  where 

r14(x)  =  L(x)  -  305175780, 
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rj(j)  =  ili(x),  1  =  1,13  and 
ri+1(x)  =  Ri(x)  i  =  14,  ...24 

Superlindo  required  2438  iterations  to  solve  the  above  LP  problem  with  full  accuracy.  Be¬ 
cause  one  cannot  enter  linear  inequalities  directly  into  Superlindo  we  entered  the  following 
problem:  min  L(x)  subject  to 


r{(x)  <0  1  <  i  <  25. 

Thus  when  phase  I  was  finished  the  problem  would  terminate.  This  took  2236  iterations. 
Let 

r(x)  =  Ax  —  b. 

The  components  of  A  and  b  are  listed  at  the  end  of  this  section. 

A  simple  scheme  of  row  scaling  was  used  to  convert  to  a  better  scaled  problem.  Let  bm 
be  the  maximal  component  of  the  right  hand  side.  bm=305175780.  The  scaled  system  is: 

(6m/|6i|)rj(x)  <  0  i  =  1,2, 3,...,  14 

bm  ri(x )  <0  i  =  15, ...,  25 
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Thus  4.0  should  be  used.  Some  computations  were  made  before  4.0  was  coded  using  an 
ad  hoc  procedure  of  an  overrelaxed  gradient  step  to  move  off  a  degenerate  point  x.  The 
step-length  chosen  was  100/||Jf(x)||.  This  has  worked  for  this  problem  in  at  most  3  steps 
for  every  example  (over  100)  tried.  However  the  penalty  function  usually  increases  during 
these  perturbations.  Subsequently,  the  method  of  4.0  was  coded.  The  results  were  similar 
to  those  given  below,  with  the  moves  in  the  null  spaces  (which  we  think  of  as  gear  shifts) 
replacing  the  gradient  steps. 

There  follows  15  successive  runs  with  random  initial  vectors  with  components  lying  between 
-1000  and  1000.  The  12  numbers  after  xo  are  the  components  of  the  starting  vector. 

The  last  column  contains  a  list  of  integers  in  order  1,2,3  interspersed  with  the  symbol  *. 
Each  integer  numbers  a  normal  step  of  the  algorithm  while  *  indicates  a  gradient  step. 
In  what  follows  disregard  this  last  column.  We  explain  first  the  lines  containing  tt,  info, 
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rmax,  number,  number,  number.  Here  tt  means  the  number  of  active  residuals;  its  value 
is  the  first  number.  Info  is  a  test  for  degeneracy;  its  value  is  the  second  number.  If  info  = 
0  the  point  is  nondegenerate,  info  =  1  ,  degenerate.  Rmax  is  the  value  oi  the  maximum 
residual.  It  is  the  3rd  number. 

Now,  the  line  that  contains  step-length,  gamma,  number,  number.  Here  step-length  = 
||if_1(x)V/(x)||.  Its  value  is  the  first  number.  The  meaning  of  gamma  is  that  of  algorithm 
3.0,  the  fraction  of  a  Newton  step.  The  value  of  gamma  is  the  second  number.  At  the 
bottom  of  the  page  we  have  x,r  number, number.  This  the  row- wise  print  out  of  the  solution 
vector  followed  by  the  residuals  at  solution. 
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APPEND  I  X 


THE  COMPONENTS  OF  THE  £L«  I R  MATRICES  A  i,  b 


FIFTEEN  RUNS  WITH  RANDOM  STARTING  POINTS 


CL  (  1  4  1  >  -  “5  . 

a  t  7 , 3  >  =  0 . 

a  1 13 , 5  >  =0 . 

IV 

z'-. 

ro 

h- 

it 

i 

a  t  3 , 3 ; =0 . 

at  14.5; =3905. 

a  t  3 ,  l ; =0 . 

a  1 3 , 3  >  -  0 . 

a  t  1 5 . 5  )  =  0  . 

a  ( 4 ,  1  )  =0 . 

a  t 10. 3 ) =0. 

a  1 16, 5 ) =0. 

a  t  5 , 1 ) =  0 . 

a  t 1 1 . 3  > =G. 

a  t 17. 5 ; =0. 

a  t  6 ,  1  )  =0 . 

at  12. 3; =0. 

a  1 18. 5 ; =0. 

aw,  1  )  =0. 

at  13. 3 j  = 0 . 

a  t  1  9 . 5  ;  =  -  1  . 

a  t  8. 1 ) =0. 

a  t 1 4 . 3 )  =  1 55 . 

a  t  20 . 5; =0. 

a ( 3 , 1  ;  =0 . 

a  t  1 5 . 3  ;  =  0 . 

a  t 21 . 5 ) =0. 

a  c 10,  1  ;  =0. 

at  16, 3) =0, 

a  t  22 , 5 ) =0 . 

at  11 .  1 ) =0. 0 

a  t 17 , 3 ) = -  1 . 

a  t  23 , 5 ) =0 . 

a ( 12. 1 ) =0. 

a ( 16. 3) =0. 

a  1 24 . 5 ; =0 . 

a  t 13, 1 ; =0. 0 

a  1 1 9 . 3 )  =  0 . 

a  t  25 . 5 ; =  0 . 

a  ( 1 4 ,  1 ) =5 . 

a  1 20 , 3  > =0. 

a  t 1 , 6 ) =- 160. 

a  i  1 5 ,  1  ;  =  - 1 . 

a <.21. 3)  =0. 

a  t  2, 6 ) = -30 . 

a  t  16,  1 ; =0. 

a  1 22, 3 ;  =0. 

a  t  3 , 6  ; = - 40 . 

a i 1 7 , 1 ) =  0 . 

idi  t  4  ,  4  j  0  * 

a  t  4 , 6 ; = -20. 

a  (  1 8 ,  1  ;  =  0 . 

a  t  24, 3 ;  =  0. 

a  t  5 , 6  ;  =  -  1 0 . 

a  t  1 9 ,  1  >  -  0 . 

a l 25 . 3) =0. 

a  1 6 , 6  ;  =  -  5 . 

a ( 20. 1 ) =0. 

a ( 1 . 4 ) = -40 . 

a  t  7 , 6  )  =  -  1 . 

a  t  2 1 «  1 )  —  0 . 

a  1 2 . 4  >  = -20. 

a  ( 8 . 6  )  =  0. 

a t 22, 1 ;  =0. 

a  t  3, 4  )  =  -  10. 

a  t  9 . 6  ;  =  0 . 

a  w3 .  1 )  - o , 

a  C  4, 4) = -5 . 

at  10. 6 ) =0. 

a  C  24 .  1 ;  -=0. 

a  1 5, 4 ) =  -  1 . 

a  1 1 1 . 6 ; =0. 

a  (  2S ,  1 ) -0 . 

a 1 6 ,  4) =0. 

at  12, 6) =0. 

a ( 1 , 2) =-10. 

a  (  7,  4 ;  =0. 

a  1 1 3 , 6 ) =0 . 

a  t  2 , 2) = -5 . 

a  1 3 ,  4  J  =0. 

a ( 14. 6 ) = 19530. 

a  t  3 , 2  )  =  -  1 . 

a  1 9,  4 ;  =0. 

a  1 15 , 6 ; =0. 

a  t  4 , 2  ;  =  0 . 

a  1 10 ,  4 ) =0 . 

a  1 16 , 6 ; =0 . 

a ( 5 , 2 ) =0 

at  1 1 , 4) =0. 

a  t 17. 6 ) =0. 

a  t  6 , 2  )  =  0 . 

at  12, 4) =0. 

a  t 18. 6 ; =0. 

a(7, 2) =0. 

a  t 13, 4  )  =0. 

a  t 19. 6 ) =0. 

a  ( 8, 2) =0, 

a  1 14, 4) =780. 

a (20. 6; =-l. 

a  t9, 2) =0. 

a  (  15, 4) =0. 

a ( 21 , 6 ; =0. 

at 10, 2) =0. 

a  t IS, 4 ) =0. 

a ( 22 , 6 ; =0 . 

a  1 1 1 , 2 )  =  0 . 

a  t  1 7 , 4 ) =0. 

a ( 23 . 6 ; =  0 . 

a  (  1 2 ,  2 )  =  0 . 

at  13, 4) =-  1 . 

a  t  24 . 6 ; =0 . 

a ( 13, 2 ) =0. 

a  1 19 , 4 ) =0. 

a ( 25 , S ) =  0 . 

a  v 1  a , 2 ) =30 . 

a  t  20 . 4  >  =0 . 

a  t  1 .  (  )  =  —  3^.0 . 

a  (  15, 2 ) - 0 , 

a  t  21 . 4  1=0. 

a  t  2, 7 ; = -  160 . 

at  16, 2; =-  1 . 

a  t  22 , 4J  =0. 

a ( 3 , 7 ; = - 80 . 

at  17, 2 ) =0 . 

a  t  23.  4 ) =0. 

a  1 4. 7 ; = -40 . 

at  13, 2; =0. 

a  t  24 ,41=0. 

a  t  5 , 7 ) = -  20 . 

at  13, 2) =0. 

a  t  25 . 4 ) =0 . 

a(6,7;=-lC. 

a  t  20 . 2 ; =0 . 

at  1, 5) =-80. 

at  7.  7) =-5. 

a  t  2 1 . 2 ) =0 . 

a  t  2,  5  >  =  -40. 

a  (  8 ,  7  )  =  -  1 . 

a  ^  —2 , _ ) =0 . 

at3,  5,'  =  -20. 

at  9,7)=  0. 

a  (  <.3,  )  =  0, 

a  t  4 , 5  ) =-10. 

a  t 10, 7 ; =0. 

a  t  24, 2 ; =0 . 

a  t  5 , 5  >  =  -  5  . 

a  t  1 1 ,  7 ; =0. 

a  t  25, 2) =0. 

a  1 6 , 5  )  =  -  1 . 

at  12,7 ;=G. 

a t 1, 3) *- 20 . 

a  t  7 ,  5  /  =  0  . 

at  13,  7 ) =0. 

a(2. 3) =- 10. 

a ( 8 . 5  ; =0 . 

a  t 1 4 , 7 ; =9  »  655 . 

a  t  3, 3 )  =  -5 . 

a  t  9 , 5  )  -  0  . 

a  t  1 5 . 7  )  =  0 . 

a  ( 4, 3 )  =  - 1 . 

at  10.51=0. 

a  (  1 6 ,  7  )  =  0 . 

a  t  5 , 3 ) =0 . 

a  t 1 1 , 5 ) =0 . 

at  1 7 , 7 / =0 . 

a (6 . 3 ; =0. 

at  12,  5 ) =0. 

a  t 16 , 7 ) =0 . 

19 

a  u  j  ,  .  j  =  ». 

ci  t.  G  .  /  ;  —  v 


G. 

488280 . 

0. 


at2l.7;=-i. 
a  C 22,  7;  =G. 
a  t — 3 , 7  J  =G  • 
a(«.4,  7)  *0 . 
a  (  25,  7) =C. 
a  ( 1 , 3 ) = -040 . 
a  t  2 , 8  /  =  -320 . 
a ( 3 , 8 / =  - 160 . 
aU.S)  =  -80. 
a  (  5 . 8;  =  -  40 . 
a  < 6 , 8;  =  -20. 
a  t  7  .  8  /  =  -  1 0 . 
a*.  3,3)*  —  5. 
a  t  9 , 8 ;  =  -  1 . 
a  t  10 «  3  ; =0 . 
at  1 1 , 8 ; =0. 
a  1 12, 3 ) =0. 
at  13,  S) =0 . 
a  t  1 4 , 3  /  =  4882i 
atlS,  8) =0. 
a  t 16 , 3 ) =0. 
a ( 1 / , 8 ) *0 . 

at  18. 8) =0. 
at  19. 3;  =0. 
a  t  20 . 8 /  =0 . 
a  1 2 1 . 8  j  =0 . 
at2 2. a; =- 1 . 
a  (  a. 3 , 8  /  — o. 
a  v  24 , 8 ) =0 . 
a ( 25 , Q ) =0 . 
a  (  1 , 9  /  =  -  1 _80 
a ( 2 , 9  / - -640 . 
a i 3 , 9 / =—320. 
a  t  4 , 9  >  = -  160 . 
a  t  5 , 9  >  *  - 80 . 
a  v  6 . 9  )  = -40 . 
a  v  i , 9  >  —  - ^0 . 
a ( S . 9 ; = -  10 . 
a  1 9 , 9 / =— 5 
a ( 10 , 9 ;  =  -  1 . 
a  t  1 1 . 9 / =0 . 
a  t 12.  9 ) =-  1 . 
a i 1 3 , 9 ) =G. 
a  t  1  4 . 9  /  =^.44 1 ' 
a  v 15 , 9 ; =0 . 
at  16, 9  / =0 . 
a  1 1 7 , 9 ) =0 . 
a ( 1 8,  a  ) =0 . 
el  l  19,  9  /  =0. 
a  v  20 . 9  /  =0 . 
at*_l,9/=0. 

cl  (  d  >  = 

a  —  3  •  9  /  =-1.0 
a  ( t- 4 , 9  /  =0 • 


0. 

1280. 
•640 . 
■320. 
160. 


10. 

5 

-  1 . 

0. 

-  1 . 

0 . 

2441405 . 
0 . 

0. 

0. 

0. 

0. 

0. 

0. 


a  t  1 ,  lO-i  = 
a  1 2 .  10/  = 
at3, 10; = 
a  v  4 . 10/  = 
a  t  5 . 10 )  = 
a  t  6 , 10/= 
at/, 10/= 
a  t  3 .  1 G  /  = 
a ( 9 , 10;= 
at  10,  luj 
a  v 1 1 ,  1o> 
aiU,  10/ 
at  13. 10/ 
a  1 1 4 , 10; 
a  1 1 5 , 10; 
a  t  16, 1C; 
a  (  17. 10 ; 
at  13. 10) 
a  t 1 9 . 10; 
a  t  20.  10 ; 
a  t  21 , 10 ; 
a  1 22  %  10; 
a  t  4.3 .  10) 
a  1 24 .10; 
a  1 25 . 10 ; 
a  1 1 .  11;  = 
a ( 2 , 11)= 
at3. 11 ) = 
a ( 4 . 11;= 
a  v.  5  .  11;  = 
a  1 6 .  1 1 )  = 
a  t  7. 11;  = 
a  t  8, 11;  = 
a  1 9 , 11;  = 
a  t 10 . 1 1 ; 
a  t  1 1 ,  1 1  ; 
at  12, 1 1 ; 
at  13, 11 ; 
atl4.ll) 
at  15.11; 
a  c 16 .  1 1 ; 
a  t  1  7 , 11; 
at  13.  11) 
a  t  1 9 ,  1 1  ; 
a  t  20 .11) 
a ( 21 , 11) 
a  t  1 1  ) 
a  t  23 .  11/ 
a  t  *.4 ,  11/ 
a  t  ...5  ,  1 1  / 
a  (  1 .  1 1  /  = 
a  t  2 ,  12/  = 
a  (  3 ,  1 2  ;  = 
a  i  4,  1  4.  /  = 
a  <  5.  12;  = 


■  1  *_  ci  0  . 
■040 . 
■320. 

■  160 . 


=  0. 

=  0. 

=  0. 

=  - 1 . 

=  0. 

-5120. 

-2560. 

-1280. 

-640. 

-320. 

-160. 

-80. 

-40. 

-20. 

=  -10. 

=  -  5 . 

=  -  1  . 

=  0 . 

=61035155. 


a  i  8  ,  1 
a  t  9 .  1 
at  10, 
a  t  1 1 . 
a  (  12. 
a  t  1 3 . 
a  t  1 4 . 
a  t  1 5 . 
a  t  1 6 , 
a  t  1  .  . 
at  13, 
a  t  1 9 , 
a  t  20 , 
a  t  21 . 
a  t  22 . 
a  t  23 . 
a  t  _4 , 
a  t  25 , 
b  t  1  /  = 
b  (  2  )  = 
b  t  3  )  = 
b  t  a  ;  = 
b(5)  = 
b  (6 ;  = 
b  t  7  )  = 
bta;  = 
b  t  9  ;  = 
b  t  10  / 
b  t  1 1 ; 
b(  12; 
b  t  1 3  / 
b  t  14 ; 
b  t  1 5  ; 
b  1 16 ; 
b  t  1 7  ; 
b  1 18 ; 
bt  19) 

b  1 20 ; 
b  t  2 1  ; 
b  t  22 ) 
b  t  23 ) 

b  t  24  / 

b  V  25  / 


/  —“St-/. 

2-  J  2  ■  w  . 

12 ) = -20. 

1 2  -  =  -  1  0 . 

12/ =-5. 

12/  =-  1 . 

12)=  305 17578 
12) =0. 

12/ =  w . 

1  4.  /  =  U  . 

12/ =0. 

12/ =0. 

12/ =  0 . 

12/ =  0 . 

1 «_  /  =  i> . 

1.  d—  )  “  3  • 

12/  =  0 . 

12/ =0. 

-  4096 . 

-2048. 

-  1 024 . 

-512. 

-256. 

-128. 

- 64 . 


-  1  . 

30517573  0 . 

0. 


‘-1. 

1 0240 . 
5120. 
2560 . 
1230. 
640. 


RUN  #1  li  Newton  steps  and  a  gradient  steps. 


xO  -  1 57 . 239626 7GS99G 

507. 770637071353 
-S77. 746807236177 
834 . 835221023124 


—  t  43.  3*.*.  I  0333d-,  38 
561 . 201493434374 
-361. 133548071757 
563. 4129*49712323 


tt .  info, rmax, 
1 1 ,  info,  i'nax, 


7.00000000000000 
14. 0000000000000 


steplength. gamma  47  ^65. 5239230591 

1 1 .  i n  f  o .  i ma  x ,  la. 0000000000000 

step  length,  gamma  19. 2S756al 130305 

1 1 ,  Info, i ma  x ,  12. 0000000000000 

step  length, gamma  5454.  13223736253 

tt, info, i max,  la. 0000000000000 

step  length, gamma  17. 3705077615239 

tt,  into,  nnax,  12. 0000000000000 

steplength, gamma  5472. 94705380250 

tt, info, rmax,  13.0000000000000 


1 1 ,  info, rmax , 
1 1 . info, rmax, 


1 . 00000000000000 
19. 0000000000000 


steplength. gamma  198. 732501363430 

tt, info, rmax,  13. 0000000000000 

steplength. gamma  196. 752514409908 

tt,  info,  max,  14 . 0000000000000 


-  9 , 1.  j  /  sl&ou  j  1  '  ii 
“593. 533a33650a.jl 
a25 . 520516159173 
268. 597848237653 

296624527029. 61 1 
965325764a97 1 . 96 


1 . 00000000000000 

0  235 7700 1 9 7 . 06 739 

1 . 00000000000000 

0  2428295204.71995 

0. 3G5175781250000D-GG 

0  2a2822 1 099 . 03 1 33 

1 . 00000000000000 

0  1185139263.73383 

0. 7629394531 2 5000 D- 00 

0  1165130226. 38878 

1  620675091.14548 

1  163062290989.794 

1.00000000000000 

0  153611593.072991 

0. 1 525 8 789 06 2 5 000 D- 00 

0  153610594.293101 


steplength, gamma  66. 3907250047904 
tt, info, rmax,  13.0000000000000 


0. 10742 1 8 75 000000 D- 00 1 

0  15^.948384. 537au3 
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steplength, gamma  83. 3248672145210 
tt, info, rmax,  16. 0000000000000 

steplength, gamma  0.584973381718277 
tt, i nf o, rmax ,  12.0000000000000 

steplength, gamma  0. 504481 166507457 
tt, info, rmax,  12.0000000000000 


steplength, gamma 
1 1 .  info. r  max , 


0. 93S594908682337D-014 
12.0000000000000 


0. 131835937500000D-001  9 

0  1 52548504 . a2 1 1 50 

1.00000000000000  10 

0  133329412.531193 

1 . 00000000000000  1 1 

0  0. 2503395080566a  ID-005 

1 . 00000000000000 
0  0.0000000000000 00 


;  .  r  0. 1 656299752 1 7 302D- 

0. 1756a43109261 16D-030  0 

0. 173795918181504D-029  0 

0.  13607  8506 150625D-028  0 

1 . 00000000000000 
-457763664. 000000 
-457763664.000000 
- aS  776 j664 . 000000 
-457763664. 000000 
-0. 505a62562 15801 0D-023 
-0. 126012992240322D-021 
"0. 1 0532429202 1 762D - 020 
-0. 8185202122834080-020 


0 

-0 

-0 

-0 

-0 


031  0.608593862426366 

. 412919380076623D-030 
. 3451 26646034 193D-029 
. 268214707775 144P- 028 
457763664. 000000 
45776366a. 000000 
457763664. 000000 
457763664. 000000 
. 000000000000000 
. 1857231Ca234804D-022 
. 2595a9148196485D-021 
.  d.  1  064356a043524D - 020 
.  1 66 1 1 1 45 4845750D - 0 1 9 
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D-031 

0. 8504906634a 1 40  3D - 030 
0. 690253292068365D-029 
0. 5443  1  402a602a93E' - 028 
-457763664. 000000 
-45776366a. 000000 
-457763664. 000000 
-457763664. 000000 
0. 000000000000000 
-0. 536025414753610D-022 
-0. 53038304 1 9667 30D - 02 1 
“0. a  1 52  78637 1 la376D-0^0 


RUN  #2 


7  New  ton  steps  and  .3  er sdient  5  reps 


xO  -930.29289008524:; 
244. 828299272343 
-508. 577056980336 
416. 323740083475 


-863.  60-4227490599 
719. 519989562319 
-  162.246891100147 
-708. 495647012945 


1 1 .  Info, rmax , 
1 1 .  inro, rmax , 
1 1 .  into. r  max . 


8.00000000000000 
1 . 00000000000000 
16 . 0000000000000 


-344. 3179136 C 7396 
543. 454996043431 
618. 731966442102 
253. 083220718413 
483902654639. G46 
1371 1 16230676. 67 
359774939814244. 


steplength, gamma 
tt, info. rmax. 


435728. 172539526 
12.0000000000000 


1 . 00000000000000 

0  161170653. 157925 


step  length, gamma 
1 1 ,  info, r  max , 


10514. 7146566537 
14. 0000000000000 


746532031250000-003 

0  161126391.314559 


staple ngth, gamma 
1 1 , info, r max , 


60. 451094493294" 
14. 0000000000000 


0. 3125000000000000-001 

0  156091441.193965 


staple ngth, gamma 
tt. info, rmax. 


52. 5504577006773 
15.0000000000000 


0. 125000000000000 

0  148358483.404517 


steplength, gamma 
tt, info, rmax. 


1 26 .069  758342685 
14. 0000000000000 


0. 64453 1250000000D- 001 

0  147307230.642514 


steplength. gamma 
tt,  info, r  max . 


0. 649075995343773 
12.0000000000000 


1 . 00000000000000 

0  129555772.393379 


steplength, gamma 
1 1 ,  into, rmax. 


0. 49020309 1 522860 
12.0000000000000 


1 . 00000000000000  7 

0  0 . 244379043579 102D-0G5 


steplength. gamma 
1 1 ,  info, rmax , 


0. 9131 138863539 10D-01 4 
12.0000000000000 


1 . 00000000000000 
0  0.000000000000000 


x  .  r  0. O31259950434605D-031  0 . 1 00 1 48357 1 08 1 36D-030 


0. 200296714216273D-030 
0.  1 6 763294235946 5D -029 
0. 1341 06 35 38875 7 2D -028 
1 . 00 G 00000000000 
-457763664.000000 
-457763664. 000000 
-457763664. 000000 
-45 t  < 63664 . 000000 
-G. 101G92S12431602D-G22 
- G  .  1  1  _  5  9677564i.D-0«_l 

-0. 103067342907010D-020 
-G. 306483 1  So J33064D -  040 


0. 409837892 165604D-030 
0.  33 773 1 07504 7746D - 029 
0. 264268403249039D-028 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
0. 0GGG0G000000000 
-0. 3G5628525956006D- 022 
-0. 250145193551635D-021 
-0. 207633318557168D-G20 
-0. 1 6 1 23C6 2 G 06 76 1 3D - 0 1 9 


0. 8l967578433l~G7D-G3u 
0. 6803925307531230-029 
0. 5 285 368064980 78D-G 23 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
0. 000000000000000 
-0. 61 125705 191 201  2D- 022 
-0. 51 1575 1326771 30D-021 
-0. 409260 106141704D-020 
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RUN  #3 


Newton  steps  end  1  gradient  step 


3S*+. 636  1 86G++0327 
690.  55666++G74G00 
323 .  d3aau45ui4‘*3 
•  9 »+ .  6 1  +_59-+ 1 635  <  03 


521 . 53239147395' 
22.69 91 136970037 
823. 566592993691 
-*4-66.  ++66+*467669G7 


-700. 0580636401' 
-639.  569++22*+3933C 
996. 3*+G 1 13237574 
-45G.  87665423601*+ 


1 1 ,  into, r max , 


17.0000000000000 


u 


529467259301 . 06*+ 


steplength, gamma 
1 1 ,  into,  i'  ma  x  , 


2212. 27366081213 
14. 0000000000000 


1 . OOGOGGGOGGOOOO 

0  194786357.815711 


steplength, gamma 
tt, Info, rmax. 


11 . 5597435264857 
15 . 0000000000000 


0. 937500000000000D-001 

0  179212381.151034 


steplength, gamma 
tt, info, rmax, 


17. 4100726479677 
15.0000000000000 


0. 312500000000000D-001 

0  1  7395 77 1 3 . 602C83 


steplength. gamma 
1 1 ,  info, rmax , 


13. 1910259009825 
16. 0000000000000 


0. 109375000000000 

0  156186399.016667 


steplength. gamma 
tt. info. rmax. 


*4. 33786792413538 
1 7 . 0000000000000 


0. 375000000000000 

0  1 26699425  .  GoS *_+.5 


steplength, gamma 
1 1 ,  info, rmax . 


0. 65430r+890885739 
12. 0000000000000 


1 . 00000000000000 

0  1  34 1 1 1  069 . 5*4632  . 


steplength. gamma 
1 1 .  info, rmax . 


0. 507437943699474 
12.0000000000000 


1 . 00000000000000  7 

0  O . 25033950805664 1 D - 0G5 


steplength, gamma  0. 936796982418018D-014 
tt, info, rmax,  12.0000000000000 


1 . 00000000000000 

0  0. OOOOOOOOCOOGOOO 


;  ,  r  0.13096323621833; 
0. 140207699951391D-030 
0. 1737959 18 18 1504D- 029 
0. 1 3805 06584 13677D- 028 
1 . 00000000000000 
-457763664. 000000 
-457763664.000000 
-457763664. 000000 
-457763664. 000000 
-0. 399668072404008D - 023 
-0. 113787851202082D-021 
-0. 1 0532429202 1 762D - 020 
-0. 8185202 1 2283++Q8D  -020 


.D-031 


0. 485334345985583D 


0. 372860037233369D-030 
0. 345 126646034 19 3D -029 
0. 268212707775144D-028 
-457763664.000000 
-457763664.000000 
-457763664. 000000 
-457763664. 000000 
0. 000000000000000 
-0. 1481 12285655603D-022 
-0. 2595491 48 196485D-021 
-0. 210648564043524D-020 
-0. 166 1 1 1454645750D-019 


-031 

0.  850490663++41.+  03D-G3G 
0. 690253292068385 D - 029 
0. 5443 1 402<46G2-+33D - 026 
-457763664  . GGGGOu 
-457763664. GOGGOG 
-45776366++ .  GOuOOu 
-457763664. GGOGGG 
0. 0000000G0G0GGGG 
0. 4^.  i  8  i  9936  338  *+08  D  -  0,.2 
0. 53038304 1 9667  3GD -  02 1 
G.  421297  16803 7o*+8D~vj_G 
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RUN  #*+ 


(  Newton  steps 


i  O  jL  •  O  a —  O  J>  I  4  /  /  S 
3al . 27 1 154617054 
402. 873709250306 
-966. 821403447674 


741 . 53660252957 1 
324. 279857033038 
604 . 207  44  125455 1 
-693. 073136470057 


244. 383834236300 
112.  113379925655 
-321 . 373886549000 
“623. 141231756370 


1 1 ,  info, r max , 


17. 0000000000000 


1096227398623. 85 


step l ength, gamma  2002. 80968276936 

tt, into, r max,  13. 0000000000000 


1 . 00000000000000 

0  153540383.712848 


steplength, gamma  130. 062162441505 
1 1 ,  Info, t max ,  14. 0000000000000 


0. 634765625000000D - 002 

0  153117350.272783 


step  1 ength, gamma  29. 8103139169651 
t t . i nr o , r max ,  15.0000000000000 


0. 2 5390625 00 00 000D -00 1 

0  151769052.907618 


steplength, gamma  7. 61286793105905 
tt, info, r max,  16. 0000000000000 


0. 937500000000000D-001 

0  149354307.384918 


steplength, gamma  0. 480797575295140 
tt, info, c max,  12. 0000000000000 


1 . 00000000000000 

0  133329412.501193 


steplength, gamma  0. 504481166507457 
1 1 ,  into, r max ,  12 . 0000000000000 


1.00000000000000  7 

0  0 . 2443 790435 79 1 02D - 005 


steplength, gamma  0.918104743739594D-014 
tt, Info, r max,  1 . 00000000000000 


1 . 00000000000000 

1  0 . 59604644 775 3906D - 00 7 


x  ,  r  0.77037197775489 
0. 20800043399382 1 D- 03 1 
0. 202145606962884D-029 
0. 18301573001 1275D-027 
1 . 00000000000C02 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-0. 235093866 1 20005 D - 024 
-0. 29387  5562650006D-022 
~0.  7 386 1 6 302—9 ^.5 jD - 020 

- 0 . 24  2667 1683181400-018 


D-033  0.43333423748712 

0. 9629649721936180-031 
0. 91 70508023 19426D-029 
0. 7951717  9 2 46 2 760 D- 027 
-457763664. 000000 
-457763664. 000000 
-45776366*4. 000000 
-457763664. 000000 
0. 596046“4‘+7753906D-0G7 
-0. 1322431 12192503D-023 
-0.  1  34*47655  l*420643D-02i 
”0.  1 25  1 35 -4.4  4._3  1 5SGD  -  0  1  9 
—  0.  1G32298-40*.4J<_  <  2 D  —  01  < 


8D-032 

0. 44065 277 1 2 7 5300D - 030 
0. 4102076707149260-028 
0. 338263556 158770D-G26 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-0. 5960464477539060-007 
-0. 6347669385240120-023 
-0. 61 68994246988920- 02 x 
-0. 5585196742639730-019 
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RUN  #5 


7  Newton  steps 


x  u 


-11a. 147717656216 


553. 47002266226a 


-a9C. 039243619173 


624. 461662al9657 
33. 737764^091533 
-427. 420645454674 

-654. 960097720481 
675. 86088001 1940 
-607. 602961981098 

-  156. 586812026271 
297. 942673453505 
-603. 144542822476 

info, rmax ,  19 . 

0000000000000 

0 

762a034 7325 3 . 473 

step  length, gamma 
tt.  Info, rma  x , 


1696. 80530559346 
13. OOOOOOOOGOOOO 


1 . 00000000000000 

0  1 94664a62 . 9 3265 1 


steplength, gamma 
1 1 ,  1  nr  o , rmax , 


78. 727748048734; 
15. 0000000000000 


0. 122070312500000D-003 

0  194642039.668371 


steplength, gamma 
1 1 ,  info, r max , 


10. 53012452574; 
16. 0000000000000 


0. 125000000000000 

0  171746426.699385 


steplength, gamma 
1 1 ,  Info, r max , 


8.22887713006761 
16. 0000000000000 


0. 156250000000000D-001 

0  169253335. 804595 


steplength. gamma 
1 1 ,  info, r max , 


4. 4053446ll3a211 
18. 0000000000000 


0. 312500000000000 

0  1 25867764 . 376646 


steplength, gamma 
tt. info. rmax. 


0.637037280856529 

12. 0000000000000 


1 . 00000000000000 

0  134638564. 993735 


steplength, gamma 
1 1 ,  info.i ma  x , 


0.509430809427019 

12.0000000000000 


1 . 00000000000000  7 

0  0 . 25033950805664 1 D - 00 5 


step  1 ength, gamma  0 . 93674580055 1 893D- 0 1 4  1.00000000000000 

tt,  inf o. rmax,  12.0000000000000  0  0.000000000000000 


x  .  r  0. 1088150418578 
0. 1 17866912596499D-030 
0. 173795918181504D-029 
0. 1 3805065841 36 77D- 028 
1 . 00000000000000 
-a57763664. 000000 
-457763664. 000000 
-45776366a. 000000 
-457763664. 000000 
-0. 332077146394506D-023 
-0. 9497994 19 12481 9D-022 
-0. 1 06628924764930D- 020 
-0. 8185202122834080-020 


D-031  0.39674156854377 

0. 31 123027901 2977D- 030 
0. 35005702669 1824D-029 
0. 2682 1 2 707775 1 44D- 028 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
0. 000000000000000 
-0. 1210759160518C2D-022 
-0. 2332 180751 9 1045D-021 
“0. 2 1 36 5 7849 5 2986GD - 020 
-0.1661 1 145a84575GD-019 


ID-031 

0.  76420900 1 9328550 -03 
0.  7001 140533836480-02 
0. 5443 1 4024602496D- 028 
-457763664. 000000 
-45776366a. 000000 
-457763664. 000000 
-457763664. 000000 
0.000000000000000 
-0.  359701265163607D-G22 
-0. 53038304 1 966730D - 02 1 
-0. 4212971660670460-020 
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ip  c< 


o  o 


RUN  #6 


(  Newton  steps  and  2  gradient  steps 


xO  472.3610796810*8 
899. 660706261435 
64.0326036041202 
955. 477280014122 


-831.003678005437 
814. 735*102335*8 
-59. 8063268680016 
6*0. 867128180124 


-740. 935969423671 
-652. *88692051425 
72.9986403563025 
712. 585229961250 

2680838119*3.665  * 

237150*9130988.6  * 


tt,  info, rmax,  5.00000000000000 

tt, Info, fmax,  16 . 0000000000000 


steplength. gamma  50637. 9972940535 
tt. lnfo.rmax,  12.0000000000000 


1.00000000000000  1 
0  161169141 . 153651 


step  1  eng th, gamma  10514. 71266361 19 

tt, Info, rmax ,  14. 0000000000000 


0. 2746582031250000-003 

0  161124874.726943 


step  length, gamma  60. 4510874755542 

tt,  Info,  max,  14.0000000000000 


0. 312500000000000D-001  3 

0  156089971.999712 


steplength, gamma  52. 5504645937000 
tt, 1  nr o, rmax,  15.0000000000000 


0. 125000000000000 

0  148358479.968610 


steplength. gamma  126. 089752134237 
tt,  Info,  max,  1  *.  0000000000000 


0. 644531250000000D-001  5 

0  147307227.428061 


steplength, gamma  0 . 6*9075033909 147 

tt, info, rmax,  12. 0000000000000 


1 . 00000000000000  6 
0  129555772.393379 


steplength, gamma  0. 490203091522860 
tt. info, rmax,  12. 0000000000000 


1 . 00000000000000  7 

0  0. 2443790435791020-005 


s tep 1  eng th , gamma  0. 91 19245*6507179D-014  1.00000000000000 

tt. info, rmax.  1 2 . 0000000000000  0  0.000000000000000 


x  .  r  0. 331259950434605D-031  0 . 986076 1 3 1 526265D-03 1 


0. 200296714216273D-030 
0. 167632942359465D-029 
0.  1 3*1063538875  72D-028 
1 . 00000000000000 
-457763664. 000000 
-45776366*. 000000 
-*5776366*. 000000 
-*5776366*. 000000 
-0. 101092512*316020-022 
-0.  12*13220131 1 3620 -02  1 
. 1 0 1 5627 1 0 1638*20-020 
. 806*6315033806*0-020 


0. 406756404254584D-030 
0. 3328006943901 14D-029 
0. 264268403249039D-028 
-457763664. 000000 
-45776366*. 000000 
-457763664. 000000 
-45776366*. 000000 
0. 000000000000000 
-0. 3009265*66336060-022 
-0. 250 1*51 9355 1685D-021 
-0. 20*630053070852D-020 
-0. 1 588692 17678544D-019 


0. 819675784331207D-030 
0. 67053 1769437860D-0 
0. 5206481 9 7445 868D-0 
-457763664.000000 
-457763664.000000 
-457763664.000000 
-457763664.000000 
0.000000000000000 
-0.61 1257051912012 D -022 
-0. 51 1575132677 130 D-O2J 
-0. 40926010614170*0-020 
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f  'J  N 


RUN  #7 


8  Newton  steps 


xO  -980.614385562064 
872.092335185815 
-787. 423383854608 
-801.412660064975 


754.663860379469 
903. 372305432807 
-889.882406466205 
-257. 581608353113 


-849.966118423708 
903.822716644623 
-656. 189370753424 
-733.888854017488 


tt,  Info,  max, 


20.0000000000000 


930810709180. 125 


steplength, gamma 
tt.  Info,  max , 


2781 . 62252337554 
12.0000000000000 


1 . 00000000000000 

0  153611829.496706 


steplength, gamma 
1 1 ,  Info, rmax , 


3648. 13836926195 
1 5 . 0000000000000 


0. 39 1006 4697 26 563D- 004 

0  153605823.174790 


steplength, gamma 
tt, Info, rmax. 


64.0782140937533 

16.0000000000000 


0. 830078125000000D-002 

0  153096180.228943 


steplength, gamma 
tt, Info, rmax, 


27.6115425905722 

15.0000000000000 


0. 19S312500000000D-001 

0  152568067.708317 


steplength, gamma 
tt, Info, rmax. 


73. 2258353230729 
15.0000000000000 


0. 305 175781 25 0000 D- 004 

0  152567395.728954 


steplength, gamma 
tt, Info, rmax. 


0. 340599172069112 
12.0000000000000 


1 . oooooooooooooo 

0  132047268.790020 


steplength, gamma 
1 1 , Info, rmax , 

steplength, gamma 
tt, Info, rmax. 


0.  499630146021219 
12. 0000000000000 

0. 934835255493608D-014 
12.0000000000000 


1 . OOOOOOOOOOOOOO  7 

0  O. 250339508056641D-005 

1 . OOOOOOOOOOOOOO  8 

0  0.000000000000000 


x  .  r  0. 215704153771370D-031  0. 801 186856865090D-031 


O. 20645969003831 2D -030 
0. 168865537523873D-029 
0. 1 36078506 150625D- 02 8 
1 . OOOOOOOOOOOOOO 
-457763664.000000 
-457763664.000000 
-457763664. 000000 
-457763664. 000000 
-0.658276825 1360 13D-023 
-0. 1 260 1299224 0322 D- 021 
-0. 10*571975650 1 78D-020 
-0.818520212283*080-020 


0. 4129 1 9 3800766 23D- 030 
0. 342661 45 5 705 37 7D- 029 
0. 268212707775144D-028 
-457763664.000000 
-457763664.000000 
-457763664.000000 
-457763664.000000 
0. 000000000000000 
-0. 244502820 76 4805D- 022 
-0. 2 5 766 8 35 7 26 7525 D- 021 
-0. 2076393 1 8557 188D-020 
-0.  163704042456682D-019 


O. 8443276876 1936 4D- 030 
0. 680392530753123D-029 
0. 536425415550288D-028 
-457763664.000000 
-457763664.000000 
-457763664.000000 
-457763664. 000000 
0.000000000000000 
-0. 630064961201612D-022 
-0. 5153367 14535050D-021 
-0. 4152786371 14376D-020 
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RUN  #8 


9  Newton  steps 


xO  489.859138456204 
174. 179628824158 
425.973625697280 
955.040074874622 


20.9052331088909 
-653. 211700218227 
-171. 141846780673 
-896. 536088135900 


-633.600054840564 

675.884989041090 

■754.508656207635 

206.621797933154 


tt,  info,  max, 


18. 0000000000000 


273601096408. 878 


stepiength, gamma 
tt,  Info,  max, 


2023. 42010222668 
12.0000000000000 


1 . 00000000000000 

0  159079979.545477 


stepiength, gamma 
tt.  Info,  max, 


15612. 1105994219 
14.0000000000000 


0. 190734863281250D-005 

0  159079676. 124495 


stepiength, gamma 
tt, Info, rmax. 


23. 5758796432499 
16 . 0000000000000 


0. 781 25000Q000000D-002 

0  158553666.463820 


stepiength, gamma 
tt, Info, rmax, 


18.9507539629753 

15.0000000000000 


0. 125000000000000 

0  154534990.248806 


stepiength, gamma 
tt, info, rmax. 


34. 1524046774300 
16.0000000000000 


0. 244 1406 25000000D- 003 

0  154529135.196641 


stepiength, gamma 
tt, Info, rmax, 


92.0011728271753 
14. 0000000000000 


0. 2B0761718750000D-001 

0  153934008. 178371 


stepiength, gamma 
tt, info, rmax. 


0. 213780894549538 
12.0000000000000 


1 . 00000000000000 

0  129555772.393379 


stepiength, gamma 
1 1 , info, rmax , 


0. 490203091522860 
12.0000000000000 


1.00000000000000 


8 


0. 238418579101563D-005 


stepiength, gamma 
1 1 , inf  o , r max , 


0. 895106789666395D-01 4 
1 . 00000000000000 


1 . 00000000000000  9 

1  0. 596046447753906D-007 


x  ,  r  0. 776390508831 104D-033  0. 433334237487128D-032 


0. 206074504049434D-031 
0. 204610797291700D-029 
0.  18301573001 1275D-027 
1 . 00000000000002 
-457763664. 000000 
-457763664.000000 
-457763664. 000000 
-457763664.000000 
-0. 23693557601 1567D-024 
-0. 293873582650006D-022 
-0. 2 7986 16902 2 925 3D -020 
-0. 242637 1688181 40D-0 18 


0.  96296 49 72 1 9 36 18D- 031 
0. 917050802319426D-029 
0. 7951 71792 46 2 780D- 027 
-457763664.000000 
-457763664.000000 
-457763664.000000 
-457763664. 000000 
0. 596046447753906D-007 
-0. 1322431 12192503D-023 
-0. 1 36357342349603D-021 
-0. 125185444231580D-019 
-0. 104770587 172276D-017 


0. 44681 574709 78 39D- 030 
0. 4102076707 14926D-028 
0. 343312265952184D-026 
-457763664.000000 
-457763664.000000 
-457763664 . 000000 
-457763664.000000 
-0.  596046 44 77 5 3906 D- 00 7. 
-0. 628889466871012D-023 
-0. 6244225884 14732D-021 
-0. 558519674263973D-019 
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RUN  #9 


10  Newton  steps  and 


g rad ient  step 


xO  -834.972506153810  -983.769175140755  447.07590108968 

-875.078848947569  924.303418741492  38.9442774086471 

-795.176371801571  -0.500703910808475  487.150834676203 

-3a6 . 78240 7wS02 34  322. 6 16508754433  721 . 5 1 1346799489 

2 

1 1 .  into. r  max , 

7. 00000000000000 

1  300222521428.460 

* 

1 1 , info. r max , 

1 5 . 0000000000000 

1  17359103350870. 1 

* 

step  length. gamma 

1 1 ,  inro,  i'  ma  x  . 

54027.8046190082 

12. 0000000000000 

1 . 00000000000000 

0  1786211071.36421 

1 

steplength, gamma 

1 1 ,  info, i max . 

15776. 5628664350 

1 4 . 0000000000000 

0. 3 1 66 1 9873046875D - 003 

0  1785645521.44156 

di. 

steplength. gamma 

1 1 ,  info, rmax . 

27. 7719244099574 
14.0000000000000 

0. 250000000000000 

0  1339238345.83148 

3 

steplength, gamma 

1 1 , info, rmax , 

8. 49827918067834 
12.0000000000000 

1.00000000000000 

0  590430919.804070 

4 

steplength, gamma 

1 1 ,  info, t max , 

2736.52420367105 

13. 0000000000000 

0. 762939453125000D-005 

0  590426415.173640 

5 

steplength, gamma 
t t , info, r max , 

47.6924304507833 

14.0000000000000 

0. 781 250000000000 D- 00 2 

0  585835987.155582 

6 

steplength. gamma 

1 1 , info, rmax . 

8. 13685607249363 
15.0000000000000 

0. 625000000000000D-001 

0  549466999.076904 

i 

step  1  eng  t h , gamma 

1 1 ,  info, rmax, 

42.5352574148447 

16.0000000000000 

0.328125000000000 

0  370527291.853912 

8 

steplength, gamma 

1 1 ,  info, r max , 

1.55797420666023 

12.0000000000000 

1.00000000000000 

0  133329412. 581 193 

9 

steplength, gamma 

0.504481166507457 

1 . 00000000000000 

10 

tt, info, rmax, 

12.0000000000000 

0  0. 250339508056641D 

-005 

steplength, gamma  0. 936377296560471D-014  1.00000000000000 

tt.  info,  rmax,  12.0000000000000  0  0.000000000000000 

x  .  r  0. 165629975217302D-031  0 . 597038282760043D-03 1 


0. 1756448109281 16D-030 
0. 1737959 18 18 1504D- 029 
0. 1 3805065841 36 77D- 028 
1.00000000000000 
-457763664.000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-0. 505a62562158010D-023 
-0. 1288341786337630-021 
-0. 1045719756501780-020 
-0.8185202122834080-020 


0. 422163843809682D-030 
0. 342661455705377D-029 
0. 2682 1 2 707775 144D- 028 
-457763664.000000 
-457763664.000000 
-457763664.000000 
-457763664. 000000 
0. 000000000000000 
-0. 182201621243004D-022 
-0. 25 766835 7267525D - 02 1 
-0. 2 1 0648534043S24D - 020 
-0. 1661 1 1454645750D-019 


0. 844327687619364D-030 
0. 6902532920683850-029 
0. 54431 402460249 8D- 028 
-457763664.000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
0. 000000000000000 
-0. 5360254147536100-022 
-0. 53038304 1 366 730D- 02 1 
-0. 421297 16308704SD-G20 
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RUN  #10 


7  Newton  steps 


■ 

I 

I 


xO  168.562088607904 
-215.631795284871 
-312.386754660958 
-783. 756813578536 


879.936512051979 
386. 541205751119 
-847.804830474609 
-462. 177283109723 


282. 756764008947 
-272.694289835621 
-918.030969523965 
318. 376253985250 


tt, Info, rmax,  18.0000000000000 


0  280160813516.508 


step  length, gamma  1935. 29079830120 
tt, Inf o, rmax,  12.0000000000000 


1 . 00000000000000  1 
0  851810879.278383 


steplength, gamma  7019.68685306682 
tt, Info, rmax,  14.0000000000000 


0. 122070312500000D-003  2 

0  851706898.458158 


steplength, gamma  78. 7484599706272 
tt, info, rmax,  13.0000000000000 


0. 781250000000000D-001  3 

0  785166074.844281 


steplength, gamma  335.697096172363 
tt, info, rmax,  14.0000000000000 


0. 209960937500000D-001  4 

0  768681659.969552 


steplength, gamma 
1 1 , Info, rmax , 

steplength. gamma 
tt, Info, rmax, 


3.57321680138793 

12.0000000000000 

0.490203091522860 

12.0000000000000 


1 . 00000000000000  5 

0  129555772.393379 

1 . 00000000000000  6 

O  0. 244379043579102D-005 


steplength, gamma  0. 913177239355039D-014 
tt, inf o, rmax,  12.0000000000000 


1 . 00000000000000  7 

O  0.000000000000000 


x  .  r  0. 325482160601443D-031  0. 986076131526265D-031 


0. 200296714216273D-030 
0. 1 6 76 32942359465 D- 029 
0. 1 34 1 0635 38875 72D- 028 
1 . OOOOOOOOOOOOOO 
-457763664.000000 
-457763664.000000 
-457763664.000000 
-457763664. 000000 
-O. 993292709357019D-023 
-0.  125072596775842D-021 
-0. 1015627101638420-020 
-0. 806483150338064D-020 


0. 409837892165604D-030 
0. 3328006943901 14D-029 
0. 26 4 26 8 40 3 2490 39D- 028 
-457763664. 000000 
-457763664.000000 
-457763664.000000 
-457763664.000000 
0 . 000000000000000 
-0. 300926548633606D-022 
-0. 250 145 19355 1685D-021 
-0. 20763931 8557 188D- 020 
-0. 16 1 2966 30 06 76 13D- 01 9 


0. 8 1 9675784331 207D -030 
0. 680392530753123D-029 
O. 528536806498078D-028 
-457763664.000000 
-457763664.000000 
-457763664.000000 
-457763664.000000 
0 . 000000000000000 
-0. 6 1125705 19 1201 2D -022 
-0. 51 1575 132677 130D -021 
-0. 4092601 06 141 704D -020 


o  c 


RUN  #11 


10  Newton  steps  end  2  gradient  step 


xO  -507. 462338260756 
460.053875018011 
-554. 3456881 16258 
-905.916211360387 


-745. 331526294334 
-77. 6430245183148 
-506. 4273^9605299 
-924.250809940748 


1 1 ,  info, rmax , 

1 1 ,  info. rmax . 

steplength. gamma 
1 1 , info, rmax . 

steplength, gamma 
1 1 ,  Info. rmax, 

steplength, gamma 
tt, info, rmax. 

steplength, gamma 
tt. info, rmax, 

steplength, gamma 
tt, info, rmax, 

steplength, gamma 
tt. info, rmax. 


9.00000000000000 
14. 0000000000000 

45364. 5042318625 
12.0000000000000 

15773. 5499860498 
14.0000000000000 

29.2671518584511 
14. 0000000000000 

10. 3875006835552 
18. 0000000000000 

2.41364909828324 
1 3 . 0000000000000 

106.889816604460 

16.0000000000000 


822. 626989288406 
-406. 981993993563 
53.2199324551891 
901. 741966752070 
282058958142. 296 
9678403149694. 32 


1 . 00000000000000 

0  4^.9  107069 . 641468 

0. 7 4 86 343 38 3 78 906 D- 004 

0  429074945.212750 

0. 625000000000000D-001 

0  402258843.273416 

0.375000000000000 

0  295236784. 148774 

1 . 00000000000000 

0  287724616.031283 

0. 244140625000000D-003 

0  287655027.217895 


steplength, gamma 
tt, info, rmax. 


9.48881403921367 

18.0000000000000 


0. 1 56 25 000 00000 00 D- 001 

0  283221899. 663543 


steplength, gamma 
1 1 ,  info. r ma  x , 


11.5704315204349 

19.0000000000000 


0. 1 56250000000000D-001 

0  27886 1 295 . 02 7645 


step  1 ength, gamma 
1 1 , info, rmax. 


0.911987664675868 
12. 0000000000000 


1.00000000000000 

0  135022355. 063402 


steplength, gamma 
1 1 , info, r max , 


0.510872132671297 

12. 0000000000000 


1. 00000000000000 


10 


0. 250339508056641D-005 


steplength, gamma  0 . 935628649 287364D- 0 1 4 

tt, info, rmax,  12.0000000000000 
x  ,  r  0. 938890847888777D-032 


0. 100143357108136D-030 
. 1565395858797950-029 
. 1 3805 065841 36 77D- 028 


1.00000000000000 
0  0.000000000000000 
0. 337037740267766D-031 

0. 659438412958 1 89D -030 


1 . 00000000000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664.000000 
-0. ^865267430337560-023 
-0. 604038 122 13041 60-022 
-0. 1063289247649300-020 
-0. 8185202122834060-020 


0. 26346 72 1 6392 1 74D- 030 
0. 35005702669 1824D-029 
0. 2632 1 2707775 1 44D - 028 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
0. 000000000000000 
-0. 1 0285 5 75392 7502D -022 
-0. 2012446293987240-021 
-0. 2136573495298600-020 
-0. 1 6 3704G42 4 566S2D - 0 1 9 


0. 7001140533836480-029 
0. 5364254 15550286D-028 
-457763664.000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
0 . 000000000000000 
-0. 3056285259560060-0^2 
“0. 4777208  9  59556490-021 
-0. 421297168037048D-020 
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RUN  *12 


10  Newton  steps 


xO  -415.465089220958 
-777. 129532256195 
-976. 113784378833 
-78. 1654829784306 


93. 3967863568357 
503.520149216688 
686.576335880251 
169.694047289757 


-655.692275827660 
-632. 224189726941 
263. 850657800655 
-953. 766508610371 


tt, info, rmax,  19.0000000000000 


0  669201674021.751 


steplength, gamma  2075.58548391905  1.00000000000000  1 

tt, Inf o, rmax,  12.0000000000000  0  495718564.127140 


steplength. gamma  4.19354626531279  0.500000000000000  2 

tt. inf o. rmax,  13.0000000000000  0  356977880.225168 


stepl ength, gamma  581.479889666029  0. 610351562500000D-004  3 

tt,  Info, rmax,  14.0000000000000  0  356957986.239844 


steplength, gamma  17. 0801205817469 

tt, Info, rmax,  17.0000000000000 

steplength, gamma  6. 52560684331984 

tt, Inf o, rmax,  15.0000000000000 

steplength, gamma  2. 399125969571 16 

tt, Info, rmax,  15.0000000000000 

steplength, gamma  18. 3964281018146 

tt, Inf o, rmax,  19.0000000000000 

stepl ength, gamma  0. 662869275097632 

tt, inf o. rmax,  12.0000000000000 

steplength, gamma  0. 510872132671297 

tt, Inf o, rmax,  12.0000000000000 


0. 781250000000000D-001  4 

0  331543988.701578 

0.500000000000000  5 

0  181610652.924412 

0.125000000000000  6 

0  162997667.387076 

0.218750000000000  7 

0  134566511.091070 

1 . 00000000000000  8 

0  135022355.068401 

1 . 00000000000000  9 


0  0. 250339508056641D-005 


steplength, gamma  0. 938228545189278D-014  1.00000000000000  10 

tt,  info,  rmax,  12.0000000000000  0  0.000000000000000 

x  ,  r  0. 938890847888777D-032  0. 342815530100928D-031 


0. 10091 872908589 ID-030 
0. 156539585879795D-029 
0. 1 380506584 1 36 7 7D- 028 
1 . 00000000000000 
-457763664. 000000 
-457763664.000000 
-457763664. 000000 
-457763664.000000 
-0.  286 5 26 7 430 83 7 56 L)- 023 
-0. 818144054097616D-022 
-0. 1 06828 9 2476 49 30D- 020 
-0. 8305572742287520-020 
PAUSE? 


0. 268089 4 4825 8 703D- 030 
0. 350057026691824D-029 
0.  272157012301249D-028 
-457763664.000000 
-457763664.000000 
-457763664.000000 
-457763664. 000000 
0.000000000000000 
-0. 10461 8995423402D-022 
-0. 201244629398724D-021 
-0. 21 3657849529860D-020 
-0. 1661 1 1454845750D-019 


0. 659438412958189D-030 
0. 7001 14053383648D-029 
0. 54431 4024602 4 98D- 02 8 
-457763664.000000 
-457763664.000000 
-457763664.000000 
-457763664.000000 
0.000000000000000 
-0. 30797951 46 1 7206D- 022 
-0. 477720895955849D-02.1 
-0. 421297168087049D-020 
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RUN  #13 


6  Newton  steps 


2  gradient  steps 


xO  536.477440169505 
-565. 2223557 1 1304 
-SO. 3906713861346 
157. 333786486445 


96 1 . 442495391034 
180. 132538508556 
-628.929442909511 
42. 1332745428034 


449. 092889887492 
768. 913749734951 
273. 24927^+2377  1  <+ 
528. 871667306334 


1 1 ,  into, r  max , 
1 1 , i nr  o , r max , 


4.00000000000000 

15.0000000000000 


1  191934030789. 158 

1  16645691039344. 1 


steplength, gamma 
1 1 ,  info, r max , 


37117.6105912337 

14.0000000000000 


1 . 00000000000000 

0  939465467.781931 


steplength, gamma 
tt, into, rmax. 


11.6912012042131 

14.0000000000000 


0. 500000000000000 

0  532153589.895607 


steplength, gamma 
tt, info, rmax. 


21 . 0876406660046 
15.0000000000000 


0. 500000000000000 

0  283305905.447359 


steplength, gamma 
tt.  Info, rmax. 


75.6961499181736 

16.0000000000000 


0.226S62500000000 

0  219586876.653159 


steplength, gamma 
1 1 ,  info, rmax, 


1 . 44623443931224 
12.0000000000000 


1 . 00000000000000 

0  133329412. 581 133 


steplength, gamma 
tt, info, rmax. 


0.504481166507457 

12.0000000000000 


1 . 00000000000000 


6 


0. 25033950805664 1 0 - 005 


steplength, gamma 
1 1 ,  info. r  ma  x , 


0. 93425201 1646448D-0 14 
12.0000000000000 


1 . 00000000000000 
0  0. 000000000000000 


x  .  r  O. 1617781 1 5328528D- 03 1  0 . 597038282760043D-03 1 


0. 174 104066972606D-030 
0. 1737959 18 181 504D- 029 
0. 1 36078506 150625D- 028 
1 . 00000000000000 
-457763664.000000 
-457763664.000000 
-457763664. 000000 
-457763664.000000 
-0. 49370 76 1 88520 10D- 023 
-0. 128834 178633763D-021 
-0. 104571975650 1 78D-020 
-0. 818520212283408D-020 


0. 422163843809682D-030 
0. 34266 1455705377D-029 
0. 2682 1 2707775 1 44D - 028 
-457763664.000000 
-457763664. 000000 
-457763664.000000 
-457763664. 000000 
0.000000000000000 
-0. 1 8220 1 62 1 2 43004D - 022 
-0. 25766 835 7 26 7525 D- 021 
-0. 210648564043524D-020 
-0. 16 1 2966300676 13D-01 9 


0. 8443276876193640-030 
0.6902532920683850-029 
0. 528536806493078D - 028 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
0. 000000000000 CO'i/ 

-0. 53 1 32343743 1 2 1 OD - 022 
-0. 5303830419667300-021 
-0. 415273637 1 143760-020 
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RUN  #14 


6  Newton  steps  3  gradient  steps 


xO  -313. 188277293696 
225.308342001151 
749. 187281293977 
21 . 637477 13259 15 


-74. 7127697490351 
-4a9. 303067641651 
334. 306731674827 
834. 136420383962 


363.859180360879 
-  '  ii.  721760127721 
566.  1363065667<+5 
-471 . 49831 1506622 


tt.  info. rmax. 
1 1 , info. r  max , 
1 1 .  info. rmax , 


8. 00000000000000 
1 . 00000000000000 
17.0000000000000 


220557173979. 063 
28 1 9394490a<4-0  .  15 
743317395805483. 


staple ng  th, gamma 
tt, info, rmax. 


695425. 145414435 
13.0000000000000 


1 . 00000000000000 

0  153587264.635352 


steplength, gamma 
1 1 ,  info, rmax , 


98. 7784435622585 
15.0000000000000 


0. 732421875000000D-002 

0  153108097.868560 


steplength, gamma 
tt, info, rmax. 


13. 9259737920949 
14.0000000000000 


0.  1 17187500000000D-001 

0  152485904.282359 


steplength, gamma 
tt, info, rmax. 


16.3951704458082 

15.0000000000000 


0. 625000000000000D-001 

0  150818862.186507 


steplength, gamma 
1 1 ,  into, rmax, 


0.71^1 1263660267  3 

12. 0000000000000 


1 . 00000000000000 

0  132047268.790020 


steplength, gamma 
1 1 ,  info, rmax , 


0. 499630146021219 
12.0000000000000 


1 . 00000000000000  6 
0  0. 2443790435791020-005 


steplength. gamma 
tt, info. rmax. 


0. 91542631 1736677D-0 14 
1 . 00000000000000 


1 . 00000000000000 

1  0. 596046447753906D-007 


x  .  r  0. 770371977754894D-033  0. 430926825056644D-032 


0. 20800043399382 ID -031 
0.  2021456069628840-029 
0. 18301573001 1275D-027 
1 . 00000000000002 
-457763664. 000000 
-457763664. 000000 
-457763664.000000 
-457763664, 000000 
-0. 235098866 1 20005 D- 024 
-0. 293873582650006D-022 
-0. 279861690229253D-020 
-0. 242667 1688 18 140D-0  18 


0. 962964972 1 936 18D- 031 
0. 91705080231 9426D-029 
0. 795171792462780D-027 
-457763664. 000000 
-457763664.000000 
-457763664. 000000 
-457763664. 000000 
0. 596046447753906D-007 
-0.  131503428235878D-023 
-0. 1 3447655 1 420643D- 02 1 
-0. 125185444231580D-019 
-0.  1 032296432 c3z 72D - 0 1 7 


0. 44065277 1275800D-G30 
0. 4102076707 14926D-028 
0. 3382635561 5877  GD- 026 
-457763664. 000000 
-457763664.000000 
-457763664. 000000 
-457763664. 000000 
-0. S96G464«77539G6D - 00 
-0. 6347669385240 1  2D - 023 
-0. 616899424693892D-021 
-0.  55 85 1 9674263973D - 0 1 9 
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RUN  #15 


6  Newton  steps 


xO  296.981125772494 
-40.5170014433711 
78. 1184786292034 
95.5765248137808 

tt, info. rmax. 


805.619158814028 
-670.077290135360 
-737. 687608386972 
-613.386207147848 


51 . 6047080018680 
-975.512313377759 
-6.90543145820155 
-628. 146325780695 

0  744985996579.413 


19. 0000000000000 


step  length, gamma  1863. 45202256309 

tt, Info, rmax,  14.0000000000000 


1 . 00000000000000  1 
0  151289322.544588 


steplength, gamma  20. 6857895261084 
tt, Info,  nnax,  15.0000000000000 


0. 253906250000000D-00 1 

0  150658392.083229 


steplength, gamma  2. 08038227471001 
tt, info, rmax,  16.0000000000000 


0.250000000000000  3 

0  144578667.929296 


steplength, gamma  35. 9811215440998 
tt, Into, rmax,  18.0000000000000 


0. 488281250000000D-003  4 

0  144551342.269987 


steplength, gamma  6 . 59190252887505 
tt, Into, rmax,  19.0000000000000 


0. 781250000000000D-002  5 

0  144407436.410621 


steplength, gamma  0. 455879229119055 
tt, Inf o, rmax,  12.0000000000000 


1 . 00000000000000  6 
0  135022355.068402 


steplength, gamma  0.510872132671297 
t t , 1 nt o , rmax ,  12.0000000000000 


1 . OOOOOOOOOOOOOO 

0  0. 250339508056641D- 


steplength. gamma  0. 938331531860259D-014  1.00000000000000  8 

tt,  inf o, rmax,  12.0000000000000  0  0.000000000000000 


x  ,  r  0. 938990847888777D-032  0 . 342815530100928D-031 


0.  10091 872908589 ID-030 
0.  156539585879 795D-029 
0.  1 40022810676730D-028 
1 .  OOOOOOOOOOOOOO 
-457763664.000000 
-457763664.000000 
-457763664. 000000 
-457763664.000000 
-0. 286526743083756D-023 
-0. 818144054097616D-022 
-O. 1 0682892 4 76 4930D- 020 
-0. 830557274228752D-020 


0. 268089448258703D-030 
0. 350057026691824D-029 
0.  272157012301249D-028 
-457763664.000000 
-457763664.000000 
-457763664.000000 
-457763664. 000000 
0.000000000000000 
-0. 10461 89 95423402D-022 
-0. 20S006211256644D-021 
-0. 213657849529860D-020 
-0. 16611 1454845750D-019 


0. 671764364602268D-0: 
0. 700114053383648D-02 
0.  544314024602498D-02 
-457763664.000000 
-457763664.000000 
-457763664.000000 
-457763664. 000000 
0.000000000000000 
-0. 307979514617206D-02 
-0. 47772089595S849D-02 
-0. 427315699059720D-02 
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